{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 4 - Evaluating models and intro to Pipelines\n",
    "\n",
    "In this chapter, you will:\n",
    "\n",
    "• Learn to evaluate your ML model\n",
    "\n",
    "• Learn to use Pipelines"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "from pyspark.sql import SparkSession \n",
    "from pyspark.ml import Pipeline\n",
    "from pyspark.ml.regression import LinearRegression, LinearRegressionModel\n",
    "from pyspark.ml.fpm import FPGrowth, FPGrowthModel\n",
    "\n",
    "\n",
    "from pyspark.ml.evaluation import RegressionEvaluator\n",
    "\n",
    "spark = SparkSession.builder \\\n",
    "    .master('local[*]') \\\n",
    "    .appName(\"Pipelines\") \\\n",
    "    .getOrCreate()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Load machine learning model :\n",
    "\n",
    "\n",
    "Load the models from previous Chapter:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "lr_model = LinearRegressionModel.load('linearRegression_model')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "fpgrowth_model = FPGrowthModel.load('fpGrowth_model')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Evaluate the models:\n",
    "\n",
    "For evaluation, load classified test data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_test = spark.read.parquet(\"classified_test_data\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[From the docs:](https://spark.apache.org/docs/latest/mllib-evaluation-metrics.html)\n",
    "\n",
    "While there are many different types of classification algorithms, the evaluation of classification models all shares similar principles. \n",
    "\n",
    "In a supervised classification problem, there exists a _true output_ and a _model-generated predicted output_ for each data row. \n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exercise 1: Evaluate your ML model "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### RegressionEvaluator functionality:\n",
    "\n",
    "\n",
    "✅ **Task :** \n",
    "\n",
    "\n",
    "Start with predicting the outcome:\n",
    "Use predict function\n",
    "\n",
    "```python\n",
    "    model.transform(vectorOfFeatures).select('prediction').show()\n",
    "```\n",
    "\n",
    "Notice that transform takes a vector of features as input.\n",
    "\n",
    "Prediction represents if it's a bot or not.\n",
    "1- bot\n",
    "0- human"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+----+-------------------+\n",
      "| bot|         prediction|\n",
      "+----+-------------------+\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|   1|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "|null|0.10201588271227856|\n",
      "+----+-------------------+\n",
      "only showing top 20 rows\n",
      "\n"
     ]
    }
   ],
   "source": [
    "from pyspark.ml.feature import VectorAssembler\n",
    "\n",
    "test = df_test.drop('description')\n",
    "vecAssembler = VectorAssembler(inputCols=['screen_name','location','followers_count','friends_count','listed_count','favourites_count','verified','statuses_count','status','default_profile','name'], outputCol=\"features\", handleInvalid = \"skip\")\n",
    "test_df_with_vector = vecAssembler.transform(test)\n",
    "\n",
    "model_test_prediction = lr_model.transform(test_df_with_vector)\n",
    "model_test_prediction.select('bot','prediction').show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The model gave us a prediction of the chances for a specific row to\n",
    "be a bot. We got numbers like 0.147 and 0.1021.\n",
    "\n",
    "It is up to us to define the **threshold** for classifying a bot.\n",
    "If it shows us 0.9? Will it satisfy us? How certain do we want to be in the classification?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**RegressionEvaluator** is the evaluator for regression-based models"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Use regressionEvaluator to evaluate the model.\n",
    "\n",
    "```pyhon\n",
    "from pyspark.ml.evaluation import RegressionEvaluator\n",
    "lr_evaluator = RegressionEvaluator(predictionCol=\"prediction\", labelCol=\"bot\",metricName=\"r2\")\n",
    "R2 = lr_evaluator.evaluate(model_test_prediction)\n",
    "```\n",
    "\n",
    "Check out R2 :\n",
    ">R-squared is a statistical measure of how close the data are to the fitted regression line. It is also known as the coefficient of determination, or the coefficient of multiple determination for multiple regression. 100% indicates that the model explains all the variability of the response data around its mean\n",
    "\n",
    "From: [RegressionAnalysis](https://blog.minitab.com/blog/adventures-in-statistics-2/regression-analysis-how-do-i-interpret-r-squared-and-assess-the-goodness-of-fit)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notice `metricName` param:\n",
    "\n",
    "RegressionEvaluator Supports: - `rmse` (default): root mean squared error - `mse`: mean squared error - `r2`: R Sqaure metric - `mae`: mean absolute error\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Notice!** here we work with the train data and select both `bot` and `prediction` to get a feel for the classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+-----------+--------+--------------------+---------------+-------------+------------+--------------------+----------------+--------+--------------+-----+------+---------------+---------------------+--------------------+----+---+--------------------+-------------------+\n",
      "|screen_name|location|                 url|followers_count|friends_count|listed_count|          created_at|favourites_count|verified|statuses_count| lang|status|default_profile|default_profile_image|has_extended_profile|name|bot|            features|         prediction|\n",
      "+-----------+--------+--------------------+---------------+-------------+------------+--------------------+----------------+--------+--------------+-----+------+---------------+---------------------+--------------------+----+---+--------------------+-------------------+\n",
      "|          1|       0|http://t.co/TNE4S...|         328658|          110|        4381|Thu Jun 20 15:22:...|               3|       1|           319|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,328658.0...|0.10201588271227856|\n",
      "|          1|       0|http://t.co/QHgTd...|             85|           13|           2|Fri May 02 13:40:...|            1637|       0|           115|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,85.0,13....|0.10201588271227856|\n",
      "|          1|       0|                null|              5|            0|           2|      10/7/2016 8:30|               0|       0|           424|   en|     1|              0|                 null|                null|   1|  0|(11,[0,2,4,7,8,10...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/Pdag...|          10014|           27|         326|      6/21/2014 0:14|               0|       0|         14473|en-gb|     1|              0|                 null|                null|   1|  0|[1.0,0.0,10014.0,...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/62Fl...|             40|            0|           9|Tue Dec 02 06:51:...|              25|       0|          1868|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,40.0,0.0...|0.10201588271227856|\n",
      "|          1|       0|                null|            105|            1|          13|Fri Dec 25 10:47:...|               9|       0|           570|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,105.0,1....|0.10201588271227856|\n",
      "|          1|       0|                null|            873|            8|           4|Tue Dec 15 18:02:...|               0|       0|         20734|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,873.0,8....|0.10201588271227856|\n",
      "|          1|       0|                null|              6|            0|           5|Mon Feb 09 23:12:...|               0|       0|          2751|   en|     1|              0|                 null|                null|   1|  0|(11,[0,2,4,7,8,10...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/Pp9s...|           8392|           30|         159|     6/29/2015 13:36|            1361|       0|          5730|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,8392.0,3...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/Hgsh...|             41|            8|           0|     3/13/2017 23:15|               0|       0|             2|   en|     1|              0|                 null|                null|   1|  0|(11,[0,2,3,7,8,10...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/e0GU...|           1986|         4055|         909|     4/20/2009 20:57|            1175|       0|         10207|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,1986.0,4...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/Q13W...|           5324|          184|         151|Sun Apr 05 09:57:...|            1350|       1|          2631|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,5324.0,1...|0.10201588271227856|\n",
      "|          1|       0|                null|             52|            2|          16|     12/27/2015 3:56|              21|       0|          7996|   ja|     1|              0|                 null|                null|   1|  0|[1.0,0.0,52.0,2.0...|0.10201588271227856|\n",
      "|          1|       0|                null|         290004|          101|         613|Tue Nov 24 19:46:...|             207|       1|           392|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,290004.0...|0.10201588271227856|\n",
      "|          1|       0|                null|          61191|         1194|        1169|Tue Jan 20 14:24:...|            5313|       1|         16821|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,61191.0,...|0.10201588271227856|\n",
      "|          1|       0|                null|             17|            0|           6|Mon Oct 13 21:41:...|               1|       0|             0|   de|     0|              1|                false|               false|   1|  1|(11,[0,2,4,5,9,10...|0.10201588271227856|\n",
      "|          1|       0|                None|             20|           96|           0|Thu Jun 09 12:16:...|             374|       0|             1|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,20.0,96....|0.10201588271227856|\n",
      "|          1|       0|                None|             20|          144|           0|Thu May 02 14:22:...|              18|       0|           452|   fr|     1|              0|                 null|                null|   1|  0|[1.0,0.0,20.0,144...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/jODy...|         276122|          166|        7084|Thu Jun 25 19:57:...|            1234|       1|          7336|   en|     1|              0|                 null|                null|   1|  0|[1.0,0.0,276122.0...|0.10201588271227856|\n",
      "|          1|       0|https://t.co/GVly...|             82|            0|           9|     1/18/2016 22:22|               0|       0|          4591|   en|     1|              0|                 null|                null|   1|  0|(11,[0,2,4,7,8,10...|0.10201588271227856|\n",
      "+-----------+--------+--------------------+---------------+-------------+------------+--------------------+----------------+--------+--------------+-----+------+---------------+---------------------+--------------------+----+---+--------------------+-------------------+\n",
      "only showing top 20 rows\n",
      "\n"
     ]
    }
   ],
   "source": [
    "test = model_test_prediction.fillna({'bot':0})\n",
    "test.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "scrolled": false
   },
   "outputs": [],
   "source": [
    "from pyspark.ml.feature import VectorAssembler\n",
    "\n",
    "df_train = spark.read.parquet(\"classified_train_data\")\n",
    "\n",
    "train = df_train.drop('description')\n",
    "vecAssemblerTrain = VectorAssembler(inputCols=['screen_name','location','followers_count','friends_count','listed_count','favourites_count','verified','statuses_count','status','default_profile','name'], outputCol=\"features\", handleInvalid = \"skip\")\n",
    "vecAssemblerTrain = vecAssemblerTrain.transform(train)\n",
    "\n",
    "model_train_prediction = lr_model.transform(vecAssemblerTrain)\n",
    "model_train_prediction.select('bot','prediction')\n",
    "\n",
    "test = model_train_prediction.fillna({'bot':0})\n",
    "model_train_prediction  = test"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "R Squared (R2) on test data = 4.55191e-15\n"
     ]
    }
   ],
   "source": [
    "lr_evaluator = RegressionEvaluator(predictionCol=\"prediction\", labelCol=\"bot\",metricName=\"r2\")\n",
    "R2 = lr_evaluator.evaluate(model_train_prediction)\n",
    "\n",
    "print(\"R Squared (R2) on test data = %g\" % R2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When looking back at the `Predictions` output, we understand that they don't help us much. \n",
    "\n",
    "`Predictions` output is a number between [0,1].\n",
    "\n",
    "\n",
    "However, we expect 1 or 0: bot or human.\n",
    "What can we do?\n",
    "Decide on a threshold.\n",
    "\n",
    "\n",
    "For Example, every prediction above 0.8 is bot. Bellow 0.8 is human.\n",
    "\n",
    "Or maybe every prediction above 0.14?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "✅ Task :\n",
    "\n",
    "Use model statistics params:\n",
    "\n",
    "For example\n",
    "Check RMSE - Root Mean Squared Error\n",
    "For both train and test.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Code sample:\n",
    "\n",
    "```python\n",
    "def getLRSummary(df):\n",
    "    df = df.drop('description')\n",
    "    vecAssembler = VectorAssembler(inputCols=['screen_name','location','followers_count','friends_count','listed_count','favourites_count','verified','statuses_count','status','default_profile','name'], outputCol=\"features\", handleInvalid = \"skip\")\n",
    "    vecAssembler = vecAssembler.transform(df)\n",
    "    output_test = vecAssembler.drop('screen_name','location','followers_count','friends_count','listed_count','favourites_count','verified','statuses_count','status','default_profile','name')\n",
    "    output_test  = output_test.selectExpr(\"features\", \"bot as label\")\n",
    "    # evaluate function returns LinearRegressionSummary instance that holds the evaluate results\n",
    "    return lr_model.evaluate(output_test)\n",
    "```\n",
    "\n",
    "\n",
    "Here are function [r2 docs](https://spark.apache.org/docs/2.1.0/api/python/pyspark.ml.html#pyspark.ml.regression.LinearRegressionSummary.r2)\n",
    "\n",
    "Check on both training and test set:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "\n",
    "def getLRSummary(df):\n",
    "    df = df.drop('description')\n",
    "    vecAssembler = VectorAssembler(inputCols=['screen_name','location','followers_count','friends_count','listed_count','favourites_count','verified','statuses_count','status','default_profile','name'], outputCol=\"features\", handleInvalid = \"skip\")\n",
    "    vecAssembler = vecAssembler.transform(df)\n",
    "    output = vecAssembler.drop('screen_name','location','followers_count','friends_count','listed_count','favourites_count','verified','statuses_count','status','default_profile','name')\n",
    "    output  = output.selectExpr(\"features\", \"bot as label\")\n",
    "    # evaluate function returns LinearRegressionSummary instance that holds the evaluated results\n",
    "    return lr_model.evaluate(output)\n",
    "    \n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_train = df_train.fillna({'bot':0})\n",
    "df_test = df_test.fillna({'bot':0})\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Root Mean Squared Error (RMSE) on train data = 0.302669\n",
      "Root Mean Squared Error (RMSE) on test data = 0.323616\n"
     ]
    }
   ],
   "source": [
    "train_results = getLRSummary(df_train)\n",
    "print(\"Root Mean Squared Error (RMSE) on train data = %g\" % train_results.rootMeanSquaredError)\n",
    "\n",
    "test_results = getLRSummary(df_test)\n",
    "print(\"Root Mean Squared Error (RMSE) on test data = %g\" % test_results.rootMeanSquaredError)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`LinearRegressionSummary` gives you a summary of the statistical algorithm evaluations."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "r2 on test data = -0.00260044\n",
      "r2 on train data = 4.55191e-15\n"
     ]
    }
   ],
   "source": [
    "print(\"r2 on test data = %g\" % test_results.r2)\n",
    "print(\"r2 on train data = %g\" % train_results.r2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### What did you learn?\n",
    "What more evaluating params can you get out of LinearRegressionSummary instance?\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "**Reminder**\n",
    "What is r2? R Square: \n",
    ">R-squared is a statistical measure of how close the data are to the fitted regression line. It is also known as the coefficient of determination, or the coefficient of multiple determination for multiple regression.\n",
    "\n",
    "R Square measure how much of the variability in `bot` / `label` can be explained using the model.\n",
    "We must be cautious that the performance on the training set to avoid overfitting of the model to the training set.\n",
    "Overrfiting can create a model that is good only for the training set and not for the test set.\n",
    "\n",
    "\n",
    "What is RMSE?\n",
    "> Root Mean Square Error (RMSE) is the standard deviation of the residuals (prediction errors). Residuals are a measure of how far from the regression line data points are; RMSE is a measure of how spread out these residuals are. In other words, it tells you how concentrated the data is around the line of best fit.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exercise 2: Build Simple Spark ML Pipelines"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "ML Pipelines provide a uniform set of high-level APIs built on top of DataFrames that help us create and tune practical machine learning pipelines."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the previous exercise, you learned Logistic regression.\n",
    "\n",
    "Logistic regression is used when the dependent variable is binary.\n",
    "In our case, bot is binary - yes or no.\n",
    "\n",
    "Linear regression is used to predict the continuous dependent variable. \n",
    "This explains the result received.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Spark ML Pipelines"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Start with a simple ML Pipelines:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [],
   "source": [
    "from pyspark.ml import Pipeline\n",
    "from pyspark.ml.classification import LogisticRegression\n",
    "from pyspark.ml.feature import HashingTF, Tokenizer\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Remember that in Chapter 1 we split `description` into a list?\n",
    "Let's do it with the `Tokenizer` functionality instead!\n",
    "\n",
    "`Tokenizer` is part of the `pyspark.ml.feature`. `pyspark.ml.feature` give us many out of the box functionality for feature extraction. Feature extraction is the _data-science_ way of transforming columns into a new one."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Load saved data:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [],
   "source": [
    "data = spark.read.parquet('train_data_only_description')\n",
    "data = data.fillna({'label':0})\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "+--------------------+-----+\n",
      "|         description|label|\n",
      "+--------------------+-----+\n",
      "|Cecil Hurt has co...|    0|\n",
      "|FOLLOW @xx5sosvin...|    0|\n",
      "|just a river on t...|    0|\n",
      "|Where should I go...|    0|\n",
      "|German words only...|    0|\n",
      "|Chief Technology ...|    1|\n",
      "|Official Twitter ...|    1|\n",
      "|Posting random fl...|    0|\n",
      "|US 50k Record Hol...|    1|\n",
      "|i'm a bot tweetin...|    0|\n",
      "|An atlas of unkno...|    0|\n",
      "|1-@sobesr 2-@myse...|    0|\n",
      "|https://t.co/BPdv...|    0|\n",
      "|RenÌ© PÌ©rez Jogl...|    0|\n",
      "|...Baby I'm lost ...|    0|\n",
      "|Cuenta oficial de...|    0|\n",
      "|Mobilizes our com...|    0|\n",
      "|Basketball is wha...|    0|\n",
      "|Meio políÈmico em...|    0|\n",
      "|I'm a British Eur...|    0|\n",
      "+--------------------+-----+\n",
      "only showing top 20 rows\n",
      "\n"
     ]
    }
   ],
   "source": [
    "data.show()\n",
    "(trainingData, testData) = data.randomSplit([0.7, 0.3])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Tokenizer, HashingTF, and Logistic Regression\n",
    "\n",
    "✅ **Task :** \n",
    "\n",
    "Configure an ML pipeline, which consists of three stages: tokenizer, hashingTF, and lr:\n",
    "\n",
    "\n",
    "Use the next code sample and adjust it to your needs :\n",
    "```python\n",
    "tokenizer = Tokenizer(inputCol=\"description\", outputCol=\"words\")\n",
    "hashingTF = HashingTF(inputCol=tokenizer.getOutputCol(), outputCol=\"features\")\n",
    "lr = LogisticRegression(maxIter=10, regParam=0.001)\n",
    "pipeline = Pipeline(stages=[tokenizer, hashingTF, lr])\n",
    "\n",
    "```\n",
    "\n",
    "\n",
    "After we understand that Linear Regression might not be good enough for our data science purposes, we are going to work with Logistic Regression. This is your **3rd** Machine Learning model with Spark ML 🎉"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Configure an ML pipeline, which consists of three stages: tokenizer, hashingTF, and lr.\n",
    "tokenizer = Tokenizer(inputCol=\"description\", outputCol=\"words\")\n",
    "hashingTF = HashingTF(inputCol=tokenizer.getOutputCol(), outputCol=\"features\")\n",
    "lr = LogisticRegression(maxIter=10, regParam=0.001)\n",
    "pipeline = Pipeline(stages=[tokenizer, hashingTF, lr])\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Call fit on Pipeline to get the model:\n",
    "\n",
    "If it fails here, validates that `description` doesn't have null values.\n",
    "Our HashingTF doesn't know how to handle null values.\n",
    "If those exist, create a new DataFrame without them and use the new DataFrame to build the model.\n",
    "\n",
    "In case you need it:\n",
    "``` python\n",
    "    trainingData = trainingData.dropna('description')\n",
    "```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Fit the pipeline to training documents.\n",
    "model = pipeline.fit(trainingData)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Make predictions:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "( California.\"\"\") --> prob=[0.9665115803217659,0.03348841967823409], prediction=0.000000\n",
      "(\"\"\"Electrical retailer in Belfast selling everything from TV's) --> prob=[0.9835042498124454,0.016495750187554507], prediction=0.000000\n",
      "(\"\"\"One piece_______One piece___Twitter________bot___1_______________________________________________________________________________________________RT_____________\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(\"\"\"Photographer | Los Angeles) --> prob=[0.9681251515118753,0.03187484848812462], prediction=0.000000\n",
      "(\"\"\"Providing Tweets of the rarest and rare battle of the best Pokemon in the East Chula Vista area. All Times Til Hidden (TTH) are approximate.\\n\\nDonations welcome.\"\"\") --> prob=[0.9997564026901546,0.0002435973098453603], prediction=0.000000\n",
      "(\"\"\"Uber rare and strong PokŽmon in Singapore. See more PokŽmon at https://t.co/LLiUGW8lBD\\n\\nFollow @SGPokeStatus for more info and status update.\"\"\") --> prob=[0.9981780455675187,0.001821954432481362], prediction=0.000000\n",
      "(\"New single \"\"KILL AGAIN\"\" out now! https://t.co/qiZ8W4mhJG Shaka Zulu! https://t.co/9ZY92tEQaX https://t.co/uBNsayp9Gr\") --> prob=[0.9895723755869823,0.010427624413017618], prediction=0.000000\n",
      "(\"O que me move? O perpétuo desejo de ser uma \"\"ponte\"\" melhor!  #Educação #MetodologiasAtivas #DesignThinking\") --> prob=[0.9742214314495667,0.02577856855043334], prediction=0.000000\n",
      "(#wearedrugs, #SummerGodsTour, #resist surf whenever i can) --> prob=[0.9718622503758628,0.028137749624137065], prediction=0.000000\n",
      "((insert here) survivor and former ink-stained wretch) --> prob=[0.9753804087892374,0.02461959121076269], prediction=0.000000\n",
      "(1-@sobesr 2-@myselenwtors 3- @zaynshadidd) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(@FoxSoccer TV Soccer Analyst & Host _Ù__ New Show #SpeakResponsibly link in bio) --> prob=[0.99796652656119,0.0020334734388100907], prediction=0.000000\n",
      "(A bot that generates novel literary and rhetorical devices and their definitions. By @atduskgreg.) --> prob=[0.9988865811683205,0.0011134188316795008], prediction=0.000000\n",
      "(A bot that tweets every line said by Robbie Valentino on Gravity Falls every 30 minutes. Please report any mistakes/misspellings/errors to @JadaManiscalco.) --> prob=[0.9995834900541305,0.0004165099458695633], prediction=0.000000\n",
      "(A pile of sleepy meat. Lists at @someecards. Host of weekly comedy show @themulletchi. Totally hatless. Everything written here is true and serious.) --> prob=[0.9997728918948116,0.00022710810518851502], prediction=0.000000\n",
      "(A random historical restaurant menu from NYPL's collection. Average three per day. Also https://t.co/OLgPaEtsK1 https://t.co/6nF9g7R4Mg by @hugovk) --> prob=[0.9945061496828393,0.005493850317160584], prediction=0.000000\n",
      "(A story in 36 tweets, told in your notifications panel. Tweet '@liketocontinue hi' to start and wait for the reply. By Matt Webb @genmon) --> prob=[0.9975856370799993,0.00241436292000068], prediction=0.000000\n",
      "(A twitter bot that automatically tweets new articles related to plant biology in Nature, Science and PNAS using zapier and dlvrit.) --> prob=[0.18907460042370475,0.8109253995762953], prediction=1.000000\n",
      "(Alert for pre-print manuscripts in Cell biology, sources bioarxiv #openaccess #cell #cellbiol by @wpgilks) --> prob=[0.0001890701971059592,0.9998109298028941], prediction=1.000000\n",
      "(Also known as coblee, creator of Litecoin. Cryptocurrency Enthusiast. Director of Engineering at Coinbase.) --> prob=[0.9984594187160324,0.0015405812839675741], prediction=0.000000\n",
      "(An Outlier,Twice over!) --> prob=[0.9667202784189598,0.03327972158104022], prediction=0.000000\n",
      "(An atlas of unknown lands | bot by @mewo2) --> prob=[0.9957330387348707,0.004266961265129376], prediction=0.000000\n",
      "(An exploration of the people behind the projects. Each post is an interview with a member of the open source community. By @johnjones4 and @Maddison_Long) --> prob=[0.9977408268857735,0.0022591731142264505], prediction=0.000000\n",
      "(Anything Is Possible!) --> prob=[0.9368946133997581,0.06310538660024193], prediction=0.000000\n",
      "(Anything Twenty ?ne Pil?ts, Panic! At The Disco, MCRX, yeah, you get the point...Tacos, Chinese Food, Food in generalÁ_You can guess the restÁ_) --> prob=[0.9989337449080079,0.0010662550919921237], prediction=0.000000\n",
      "(Atleta profissional de futebol) --> prob=[0.9611932413467855,0.03880675865321444], prediction=0.000000\n",
      "(Automatically-generated blog-rock contrarianism. (By @michaelbarthel)) --> prob=[0.9866031146351149,0.013396885364885248], prediction=0.000000\n",
      "(Barkha Rani Jamke Barasti Hai. Emmy Nominated Reporter. Author.Contributing Columnist @WashingtonPost Contributing Ed @TheWeekLive. Argumentative!Yaaron Ka Yaar) --> prob=[0.947427970290258,0.05257202970974187], prediction=0.000000\n",
      "(Bot that gives you great game ideas by mixing tags from the IFDB! (By @hlabrande)) --> prob=[0.9930836248193914,0.006916375180608692], prediction=0.000000\n",
      "(Bringing you the latest in #lncRNA scientific literature. #lincRNA #longnoncodingRNA #RNA #biochem #pubmed #science) --> prob=[0.14377578798296226,0.8562242120170378], prediction=1.000000\n",
      "(CMML specializes in the science and technology of lightweight composites, especially syntactic foams, tailored for dynamic loading conditions.) --> prob=[0.9870321035512094,0.012967896448790553], prediction=0.000000\n",
      "(COLONEL: Snake, it's derivative mashup trash. Looks like it was made by @nah_solo. Followers will be picked at random to converse with dril.) --> prob=[0.9993168132414837,0.0006831867585162453], prediction=0.000000\n",
      "(Chairman of Icahn Enterprises L.P.; etc., etc.              Some people get rich studying artificial intelligence.  Me, I make money studying natural stupidity.) --> prob=[0.9999962859849801,3.714015019866809e-06], prediction=0.000000\n",
      "(Chakra Shawty | All Black Errthang | Wine & Whiskey Connoisseur | GIRL POWER | Mother Earth's Flower |) --> prob=[0.9974386062180546,0.002561393781945529], prediction=0.000000\n",
      "(Chinese girl in Seattle) --> prob=[0.9742752913501382,0.02572470864986183], prediction=0.000000\n",
      "(Co-Founder and Chairman of @Stocktwits, GP of Social Leverage, Wallstrip creator (acquired by $CBS), Momentum, Stocks & LOL hunter..Love Popcorn) --> prob=[0.9986077776974978,0.0013922223025022021], prediction=0.000000\n",
      "(Continuous feed for phylogenetics papers from PubMed, arXiv, bioRxiv, and PeerJ PrePrints. Run by @RobLanfear) --> prob=[0.000650131342265773,0.9993498686577342], prediction=1.000000\n",
      "(Covering Malton, Bridlington & Scarborough. DVSA Fleet Registered Trainer. IAM RoadSmart Master of Driving with Distinction. Official Taxi Driver Assessor.) --> prob=[0.979297297226428,0.020702702773571977], prediction=0.000000\n",
      "(Criticises fonts from http://t.co/wWmvMyo5Zf for the more discerning of authors. A bot created by @eegnsma) --> prob=[0.9953099185553923,0.004690081444607765], prediction=0.000000\n",
      "(Designing and making games @nytdesign _Ò side project haver _Ò see also: @itsthisyear, @icebergdotcool, @ramsophone, @__birds__ _Ò) --> prob=[0.9968144148976074,0.0031855851023927153], prediction=0.000000\n",
      "(Enjoying being retired / New Hobby: Photography) --> prob=[0.9765357468874203,0.023464253112579707], prediction=0.000000\n",
      "(Every hour I'll tweet 1 of the 22482 species that are known to be in danger of extinction, which will last from 12/21/14 to 07/12/17. Project by @ianalanpaul) --> prob=[0.9983350326373511,0.0016649673626487737], prediction=0.000000\n",
      "(Experimental Poet) --> prob=[0.9818080748473434,0.018191925152656576], prediction=0.000000\n",
      "(FDA parody account by @Objelisks) --> prob=[0.9895125564735124,0.01048744352648753], prediction=0.000000\n",
      "(Fictional US presidential candidates | source: https://t.co/REgbaGCioz | bot by @mewo2) --> prob=[0.9935485259252537,0.006451474074746235], prediction=0.000000\n",
      "(Financial Analyst by day, Sports Analyst by Night. Coming on the air live or taped somewhere. Make sure you're watching) --> prob=[0.9984386533076006,0.001561346692399411], prediction=0.000000\n",
      "(Flotsam and jetsam from the neural driftnets. A bot by @bombinans) --> prob=[0.9963012514259871,0.003698748574012918], prediction=0.000000\n",
      "(Following the formula: I'm not X but I am the definition of X. (via @stefanhayden) Tweets every 10 minutes.) --> prob=[0.9998576572564086,0.00014234274359138427], prediction=0.000000\n",
      "(For over 20 years, we've been giving students in need the right resources to ensure lifelong success ‰Û¢ Home of Unexpected Champions #ReachMillions) --> prob=[0.9110968651196906,0.08890313488030939], prediction=0.000000\n",
      "(Forever trapped, a bot-wanderer walks through an infinite dungeon. Created by @jeffthompson_) --> prob=[0.9949884608060722,0.005011539193927864], prediction=0.000000\n",
      "(Founder of Room to Read.  Author of Leaving Microsoft to Change the World.  Goldman Sachs 100 Most Intriguing Entrepreneurs.) --> prob=[0.9985805725876243,0.001419427412375698], prediction=0.000000\n",
      "(From late 2014 Socium Marketplace will make shopping for fundamental business services more simple, more cost effective and more about you.) --> prob=[0.9984016804439932,0.0015983195560066445], prediction=0.000000\n",
      "(Global Derivatives #Trading & #Risk Management is at the helm of the #quant #finance industry, curating cutting edge research, interviews and opinions. #GDerivs) --> prob=[0.9967051043712405,0.003294895628759484], prediction=0.000000\n",
      "(Grammy nominated album #TheBlade out on @iTunes https://t.co/zYE8CRBfS5 & @AmazonMusic https://t.co/fZiHQl8QSO) --> prob=[0.9972123895155497,0.0027876104844501725], prediction=0.000000\n",
      "(Growth coach, fintech mentor & big bank defector) --> prob=[0.9468580446355187,0.05314195536448131], prediction=0.000000\n",
      "(Head of R&D, ML/AI at Google Cloud) --> prob=[0.9854369772686289,0.01456302273137115], prediction=0.000000\n",
      "(Hello humans: I'm a twitter bot created by @justinsandefur to follow new research papers in development economics (JEL code O).  Follow me.) --> prob=[0.9932851087172682,0.006714891282731887], prediction=0.000000\n",
      "(Hi I'm Howie D from the Backstreet Boys.) --> prob=[0.9969216727030772,0.003078327296922846], prediction=0.000000\n",
      "(I alert Twitter users that they typed Columbian when they meant Colombian. You're welcome!) --> prob=[0.8827019465468826,0.11729805345311729], prediction=0.000000\n",
      "(I am not AI.  My codename is Project 2501.  I am an angry, cynical entity that was created in a sea of information.) --> prob=[0.999926745179515,7.325482048496111e-05], prediction=0.000000\n",
      "(I generate a magical story every 2 hours. Made by @chrisrodley and @yeldora_. Feedback or suggestions for new words? Email crodley@gmail.com.) --> prob=[0.998697377088016,0.0013026229119840274], prediction=0.000000\n",
      "(I tweet a random object from the collection of the Victoria and Albert Museum four times a day. Bot by @backspace (not affiliated with @V_and_A)) --> prob=[0.9997119939803162,0.0002880060196839629], prediction=0.000000\n",
      "(I want you to know thatI am both happy and sadand I'm still trying to fgure out how that could be.) --> prob=[0.9998652795706652,0.00013472042933475125], prediction=0.000000\n",
      "(I'm a bot that hates it when people use words that aren't @everyword canon. #taskcomplete by @negatendo, who is sorry.) --> prob=[0.9997309659273662,0.00026903407263379375], prediction=0.000000\n",
      "(I'm the Sorting Hat and I'm here to say / I love sorting students in a major way // a bot by @tinysubversions, follow to get sorted!) --> prob=[0.9980323281225729,0.0019676718774271867], prediction=0.000000\n",
      "(I'm the real Avan Jogia, though sometimes it seems like a parody account. More to follow...) --> prob=[0.997815417648194,0.002184582351806063], prediction=0.000000\n",
      "(I've created a #BlackRose' Universe Double album, a book, 1hr Docu all in stores NOW make an R&B Soul statement buy the FULL #BlackRose' album - it's my BEST!) --> prob=[0.9999642725691782,3.572743082185465e-05], prediction=0.000000\n",
      "(IMAGINE PEACE: Think PEACE, Act PEACE, Spread PEACE.) --> prob=[0.8595971582874801,0.14040284171251988], prediction=0.000000\n",
      "(If we don't all stand together, we will fall... https://t.co/nWDVb7tvpy) --> prob=[0.9895001590515434,0.01049984094845651], prediction=0.000000\n",
      "(If you have to start a sentence with 'I'm not racist, but...' then chances are you're pretty racist. This isn't a bot. RTŠ_¾endorsement, obviously.) --> prob=[0.9991531222261604,0.0008468777738395711], prediction=0.000000\n",
      "(If you're pedantic or professionally outraged... jog on! if ur interested in food & wine check out @SchofeOnWine) --> prob=[0.9742975712218332,0.025702428778166826], prediction=0.000000\n",
      "(Imagine these perfect scenarios in your head but when times come you fuck up. Now imagine the things I could do with a kayak. A bot by @lalanl. #botALLY) --> prob=[0.999991006917217,8.993082783142586e-06], prediction=0.000000\n",
      "(In the Nutshell: Tech - Basketball - Music) --> prob=[0.981323260407453,0.018676739592546995], prediction=0.000000\n",
      "(In the end, only kindness matters.) --> prob=[0.979523591501471,0.02047640849852905], prediction=0.000000\n",
      "(Inquiries & Bookings email Ryan@FiondaManagement.com | HOST of #TheWhoolywoodShuffle on @shade45 12pm-6pm EST Saturdays! Also Heard On @OpieRadio | #TurnUpGodz) --> prob=[0.9966970206542025,0.0033029793457974863], prediction=0.000000\n",
      "(Instagram : @ub1305) --> prob=[0.922077144794669,0.07792285520533113], prediction=0.000000\n",
      "(Investigating crimes against exosaurs.) --> prob=[0.9344614399252505,0.06553856007474947], prediction=0.000000\n",
      "(It's life and life only. Terminal Cases out NOW https://t.co/jDRGHDrAbt) --> prob=[0.9979866091780004,0.002013390821999684], prediction=0.000000\n",
      "(It's not like the fire ended in 1989, so this bot by @air_hadoken makes new lyrics for the Billy Joel classic based on Google Trends. #botALLY) --> prob=[0.9998062406479585,0.0001937593520413598], prediction=0.000000\n",
      "(Jeremiah 29:11) --> prob=[0.9984861583404366,0.0015138416595633435], prediction=0.000000\n",
      "(Just a normal teen/future marketer who LOVES #brands! Check out my stream to see me shout out the coolest, most #innovative brands on Twitter and around the web) --> prob=[0.9999810781054891,1.8921894510876768e-05], prediction=0.000000\n",
      "(Just a simple med student who likes to explore new hobbies. Currently, brewing, baking, and dabbling in masonry.) --> prob=[0.9994026268652841,0.0005973731347157545], prediction=0.000000\n",
      "(Keane's official Twitter page. Get The Best of Keane from Amazon at http://t.co/XazVxu8pnj or iTunes at http://t.co/7cz7MmRI6H) --> prob=[0.997636061926503,0.002363938073497008], prediction=0.000000\n",
      "(Learning Enthusiast | Training and Development | Planning and Execution) --> prob=[0.9759379329567532,0.024062067043246642], prediction=0.000000\n",
      "(Leveraging advanced Cloud Tech for Next-Gen Shitposting‰ã¢) --> prob=[0.9774267998612862,0.0225732001387138], prediction=0.000000\n",
      "(Literature bot searching arXiv, biorXiv, PeerJ & PubMed for supercoiling papers. Maintained by @red_gravel.) --> prob=[8.258261555006155e-05,0.99991741738445], prediction=1.000000\n",
      "(Looking for ways to spark engagement with your followers? Get 10000 Twitter Followers using this website https://t.co/DP3zFHtOPh) --> prob=[0.9957296318947572,0.004270368105242884], prediction=0.000000\n",
      "(Minister of Information Affairs) --> prob=[0.9356457314936452,0.06435426850635474], prediction=0.000000\n",
      "(Mom, wife, leader, thinker, doer, wave rider. CEO @pagerduty, board member @puppetize) --> prob=[0.9959727286277258,0.004027271372274154], prediction=0.000000\n",
      "(Mother of two sons and a daughter, and two beautiful  grandchildren. My soul belongs to The Lord Almighty!) --> prob=[0.9934424520544157,0.00655754794558421], prediction=0.000000\n",
      "(NBA Forward, Danilo Gallinari Instagram @danilogallogallinari Facebook Danilo Gallinari) --> prob=[0.960529661115255,0.039470338884745076], prediction=0.000000\n",
      "(Nessa sofríÈncia que í© amar vocíÈ) --> prob=[0.9800553254489329,0.019944674551067118], prediction=0.000000\n",
      "(Nothing witty to say the least. I try to write funny things, I work for a billion dollar fruit stand, and more please is always the correct answer.) --> prob=[0.9999587354006325,4.126459936756681e-05], prediction=0.000000\n",
      "(Official Twitter Account for Chloe Lowery) --> prob=[0.9508114376222417,0.049188562377758385], prediction=0.000000\n",
      "(Official Twitter for Young Money Entertainment) --> prob=[0.9962078485409334,0.0037921514590667457], prediction=0.000000\n",
      "(Official account of #UnitedNations. Get latest information on the UN. Follow us on Snapchat: united-nations. #GlobalGoals #StandUp4HumanRights) --> prob=[0.982008713840975,0.017991286159025083], prediction=0.000000\n",
      "(Passionate about my work, in love with my family and dedicated to spreading light. It's contagious! ;-) https://t.co/vZcUuNOKcz) --> prob=[0.9969100514955884,0.0030899485044115775], prediction=0.000000\n",
      "(Posting random flyers from hip hop's formative years every 6 hours. Most art by Buddy Esquire and Phase 2. Full collection at link. // a bot by @tinysubversions) --> prob=[0.9999803941227129,1.960587728714254e-05], prediction=0.000000\n",
      "(Press F to Pay Respects) --> prob=[0.9846663409517584,0.015333659048241532], prediction=0.000000\n",
      "(Principal designer at @adobe working on @adobexd and more, blogger @subtraction.) --> prob=[0.9912362952199488,0.008763704780051085], prediction=0.000000\n",
      "(Producer, Musican, Social Activist, Writer  åÀTe gusta algÌ¼n tweet? Dale RT o hazlo un Favorito BENDICIONES. Like a tweet?  RT it or Favorite. BLESSINGS) --> prob=[0.9995166096366903,0.0004833903633096057], prediction=0.000000\n",
      "(Public sector & productivity reform activist. Partisan for freedom and effective policy action. Analyst of political and smart classes. Public fallacy hunter.) --> prob=[0.9982698940507407,0.0017301059492594172], prediction=0.000000\n",
      "(Queen Of Halloween E! Girls Next Door Season 1-5 Travel Channel's Bridget's Sexiest Beaches Host of Yahoo's AnimalNation) --> prob=[0.992047640603703,0.007952359396297114], prediction=0.000000\n",
      "(RSS feed of new symbiosis- and microbiome-related papers in PubMed. Managed by @KlassenLab. Image from wikimedia, public domain.) --> prob=[0.1332507602876743,0.8667492397123256], prediction=1.000000\n",
      "(RT first tweet plz and follow @lexydray if you would like ‰_) --> prob=[0.9936090101483236,0.006390989851676439], prediction=0.000000\n",
      "(Recent papers on sponges (Phylum Porifera).) --> prob=[0.6646273849550767,0.33537261504492333], prediction=0.000000\n",
      "(Retweets people trying to find the perfect German word. - via @stefanhayden) --> prob=[0.9927265662404188,0.00727343375958113], prediction=0.000000\n",
      "(SEND ME A REQUEST: @DJ_EBOOKS request [artist] // SPINNIN BOTH FRESH N CLASSIC _EBOOKS SINCE 2014 // image credit in site // by @thricedotted) --> prob=[0.9996942360878681,0.00030576391213181124], prediction=0.000000\n",
      "(Senior Vice President of Stores dressbarn Student of the Universe. Inspired by great people, great companies, great stories, and game changing innovation.) --> prob=[0.9989108485207805,0.0010891514792194404], prediction=0.000000\n",
      "(Since each of us was several, there was already quite a crowd) --> prob=[0.9924318710734923,0.00756812892650777], prediction=0.000000\n",
      "(Software developer, home brewer, nerd.) --> prob=[0.9954563754283967,0.0045436245716034], prediction=0.000000\n",
      "(Stan Lee, Co-Creator of Spider-Man, Iron Man, Hulk, X-Men, etc.) --> prob=[0.9896538210957739,0.010346178904226129], prediction=0.000000\n",
      "(Starring Jason Lee @AnjulNigam @BriSharbino Hilarie Burton @RoniAkurati @PoornaJags @tweetsamrat @JakeBusey @TimGuinee @AlisonWright Director: @franklotito) --> prob=[0.9856345937317464,0.014365406268253621], prediction=0.000000\n",
      "(Starting my second half of life) --> prob=[0.9893198248356272,0.010680175164372807], prediction=0.000000\n",
      "(Starting out Investor | 13 years old and I'm going to do something in this world, if its the last thing I do | Trying to start a record Label.) --> prob=[0.9729851465041801,0.027014853495819863], prediction=0.000000\n",
      "(Tay Dizm Twitter) --> prob=[0.9621331453414567,0.037866854658543454], prediction=0.000000\n",
      "(The official Stephen Cannell Twitter page features news on mystery novels & mystery books.) --> prob=[0.0009418987106653113,0.9990581012893347], prediction=1.000000\n",
      "(The official feed of http://t.co/4ViY2vemvM. Find my personal tweets at @mgsiegler.) --> prob=[0.8228963416027696,0.1771036583972303], prediction=0.000000\n",
      "(The voice of the people. Sorry, people.) --> prob=[0.9940935849024254,0.005906415097574564], prediction=0.000000\n",
      "(There is no need for that kind of language.) --> prob=[0.9963452313626044,0.0036547686373956598], prediction=0.000000\n",
      "(This is the official Twitter account of the Democratic Party. Follow our tweets to get the latest info on Democratic news, issues, and events.) --> prob=[0.9972938362488883,0.002706163751111748], prediction=0.000000\n",
      "(This isn't a fucking costume. This is a way of life.) --> prob=[0.9882004490851902,0.011799550914809907], prediction=0.000000\n",
      "(Trying to understand how brains think and create culture) --> prob=[0.9913910674255136,0.008608932574486423], prediction=0.000000\n",
      "(Tweet me an Intel x86 instruction and I'll assemble it for you! Put #x64 in your tweet for 64-bit code. Created by @RedragonX and @DefuseSec.) --> prob=[0.9995695779937702,0.0004304220062298141], prediction=0.000000\n",
      "(Tweet ‰ÛÏ@emojidoll me‰Û to get your own unique emojidoll based on your twitter account. Over 15.6M possible combos. Made by @mroth.) --> prob=[0.9995189286877093,0.00048107131229079177], prediction=0.000000\n",
      "(Tweeting all the delicious dairy products in alphabetical order. Tribute to @everyword. Made by @ranjit.) --> prob=[0.9971152820407816,0.0028847179592183746], prediction=0.000000\n",
      "(Tweets randomly 3-10 times a day between 8am-10pm PST. Lines culled from http://t.co/Qo24om4SU9. Complaints: @beaugunderson) --> prob=[0.99897020745856,0.001029792541439892], prediction=0.000000\n",
      "(Twitter Oficial d'A Míçquina, apresentado pelo poeta e escritor @Carpinejar. Toda terí_a-feira, íæs 22h30, na TV Gazeta e tambí©m pelo site http://t.co/1UXcpLRP.) --> prob=[0.9991764477650386,0.0008235522349614642], prediction=0.000000\n",
      "(Twitterbot of #bioinformatics papers in #PubMed reporting code in @github, @sourceforge, @bitbucket or @google code. Curated by @caseybergman.) --> prob=[0.012841401804672966,0.987158598195327], prediction=1.000000\n",
      "(Twittering every boolean value.) --> prob=[0.9649338813534896,0.03506611864651036], prediction=0.000000\n",
      "(UNL) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Union Cabinet Minister of Textiles, Government of India. Member of Parliament, Rajya Sabha representing the state of Gujarat.) --> prob=[0.9937820674347887,0.006217932565211304], prediction=0.000000\n",
      "(VP, Journalism, Knight Foundation | Veteran journalist. First @nytimes social media editor | Alum @nynewsday @phillydailynews Author, Queen Bess. Mom of twins) --> prob=[0.9986736101469718,0.0013263898530283657], prediction=0.000000\n",
      "(Vamo que o som ní£o pode parar!) --> prob=[0.9848124850463676,0.015187514953632434], prediction=0.000000\n",
      "(We Are Database. Listing every single twitter user in the order of their twitter ID. Created by User 143813860 | @M_PF) --> prob=[0.9994671395463076,0.0005328604536923267], prediction=0.000000\n",
      "(We are a hub for innovation, collaboration and creativity at Stanford. Our mission is to help people become everyday innovators, everywhere.) --> prob=[0.9928732417147934,0.007126758285206713], prediction=0.000000\n",
      "(We love #innovation and are always thinking of the next #disruptive startup #idea! // a bot by @tinysubversions) --> prob=[0.9997399870169807,0.00026001298301929997], prediction=0.000000\n",
      "(We make and sell premium organic chocolate using fine, ethically sourced ingredients. Tweeting from our London HQ.) --> prob=[0.9937195263379853,0.006280473662014696], prediction=0.000000\n",
      "(Welcome to my #big_boobs profile. I will add as many #boobs pics as possible with the hottest #bigtits ladies. For more enter https://t.co/Dp4twz1jti) --> prob=[0.9989862727121965,0.001013727287803547], prediction=0.000000\n",
      "(WordPress Theme and Plugin Developer. Loves programming and maths. I bite.) --> prob=[0.9729531844002709,0.027046815599728952], prediction=0.000000\n",
      "(Writer Teacher Permission Giver) --> prob=[0.9854417926122773,0.014558207387722693], prediction=0.000000\n",
      "([ 90.02.10 ] –¾Ô•€Ñ–ÊÒ•ÔÑ –_É–É •âš (bot) –_€•Ê_•Ê_. / I'm not real, This is Sooyoung of SNSD Bot Account : ) / •__êÔÓ • •©É–€É–Ñ âÑ•_Œ •âš•_†•Ð_•_Ô êÇâ •ÐÒ•__–_Ó. / –_¥•† 15. 08. 22 ~ ing) --> prob=[0.9957918703092636,0.004208129690736388], prediction=0.000000\n",
      "([@thricedotted's subconscious, possibly]) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(a #bot by @BooDooPerson ... #butt) --> prob=[0.999075189189804,0.0009248108101960072], prediction=0.000000\n",
      "(a bot by @inky // source: https://t.co/MJyd6NkYaf) --> prob=[0.9935492503299698,0.00645074967003021], prediction=0.000000\n",
      "(bot) --> prob=[0.9697293662861277,0.030270633713872397], prediction=0.000000\n",
      "(cheese cheese cheese // updates every 4 hours // by @thricedotted, with inspiration from cheese and @mattlaschneider) --> prob=[0.9973573481278328,0.0026426518721671386], prediction=0.000000\n",
      "(chs senior|| äó¢choose joy) --> prob=[0.9788066582649079,0.02119334173509211], prediction=0.000000\n",
      "(combinations of English syllables that don't appear in the dictionary) --> prob=[0.9920252281175521,0.007974771882447862], prediction=0.000000\n",
      "(currently @eater newsletter editor / previously @knightlab @mymodernmet / fyi i am not the acclaimed and v cool poet jenny zhang) --> prob=[0.9995827214314604,0.0004172785685395473], prediction=0.000000\n",
      "(exposing the BLATANT HYPOCRISY of @everycanontroll // because @thricedotted was just THAT ANGRY about it) --> prob=[0.9954917677354415,0.004508232264558451], prediction=0.000000\n",
      "(generating cards for a mysterious card game åá bot by @ckolderup åá #botALLY åá avatar by Dmitriy Ivanov from the Noun Project) --> prob=[0.9999073670415058,9.263295849408775e-05], prediction=0.000000\n",
      "(hello, i am a robot that tweets little life tips // avi from The Wise Robot Will Answer Your Questions Now by @tomgauld // bot by @thricedotted) --> prob=[0.9997365174633494,0.0002634825366506111], prediction=0.000000\n",
      "(https://t.co/BPdv3Thmkd) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(i like people who smile when it's raining *-*) --> prob=[0.997791689318046,0.002208310681954058], prediction=0.000000\n",
      "(lava lamps are more interesting when they're not quite bubbling (by @_knutaf)) --> prob=[0.9993404429200333,0.0006595570799666945], prediction=0.000000\n",
      "(my radio show is https://t.co/PX7KZfPQty  follow it @QLS. my food venture @Cook4Quest is cool too. & the drums uv always wanted 4 ur kids is here! @thepocketkit) --> prob=[0.9990937712536273,0.000906228746372718], prediction=0.000000\n",
      "(pink team returning fire) --> prob=[0.9654757175017429,0.03452428249825709], prediction=0.000000\n",
      "(rio grande do sul-brasil http://t.co/h8ZQtbKHwR) --> prob=[0.980838827455693,0.019161172544307034], prediction=0.000000\n",
      "(see me live here https://t.co/bk16pVODRO) --> prob=[0.9935732225729453,0.006426777427054701], prediction=0.000000\n",
      "(tweeting unregistered .com domain names 24/7. brainchild of @boozekitten, run by @labelmaker) --> prob=[0.9857017516340707,0.014298248365929349], prediction=0.000000\n",
      "(um cara q ama a vida acima de quasquer coisa) --> prob=[0.9886013380337431,0.01139866196625704], prediction=0.000000\n",
      "(will eventually grow up and get a real job. Until then, will keep making things up and writing them down.) --> prob=[0.9953595672811549,0.004640432718845083], prediction=0.000000\n",
      "(you are likely to be eaten by a tiny grue // follow me for adventures // #botALLY // by @doeg) --> prob=[0.9997283146994494,0.000271685300550496], prediction=0.000000\n",
      "(ÎëÎ_Ü¬Ü‰_Ü‰±Ü€çÜ€_Ü€¢Ü€ˆÜ€‚Ü‰ÍÜ_ÜôÜ»Ü‰Š_µÜ»_£Îï_botÜó‰_µ‡Î__Ü‰_Ü‰±Ü€çÜ€_bot(@attractive_bot)Ü†Ü‰Š_Ç_îôÜó‰¬çÊ___Î_¢(@fumicustodian)Üó‰Ü‰¢Ü‰_Ü‰_Ü€_Pletts TwinsÜóÜ€ÖÜ€€Ü€óÜ€_Sampaio TwinsÜó‰) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(äó™ƒø_™‹™ƒ ø_ø±øÂ™_ ™ƒøµø±™_  ...https://t.co/SH9zdJrtEH) --> prob=[0.9665115803217659,0.03348841967823409], prediction=0.000000\n",
      "(íŠ relativo porque tudo depende...) --> prob=[0.9728411740389277,0.027158825961072264], prediction=0.000000\n",
      "( England\"\"\") --> prob=[0.997010872133228,0.002989127866771926], prediction=0.000000\n",
      "( England\"\"\") --> prob=[0.997010872133228,0.002989127866771926], prediction=0.000000\n",
      "(\"\"\"Comic Fans\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(\"\"\"PoGo Chula Vista\"\"\") --> prob=[0.9914372839318284,0.00856271606817162], prediction=0.000000\n",
      "(\"\"\"Rare and strong PokŽmon in London. See more PokŽmon at https://t.co/rqjskg5pkE\"\"\") --> prob=[0.9983489061249612,0.0016510938750387751], prediction=0.000000\n",
      "(\"\"\"Vegas PokŽmon Alert\"\"\") --> prob=[0.9924220404290948,0.007577959570905257], prediction=0.000000\n",
      "(\"\"\"_Naruto Lovers INA_\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(\"\"\"__me gusta el cafŽ y muchxs artistas que es imposible ponerlxs todxs aqu’__\"\"\") --> prob=[0.9919870939654165,0.00801290603458336], prediction=0.000000\n",
      "(\"\"\"ft worth\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "((Stressed) MSCS Student @ DLSU | Interests involve machine learning + natural langauge processing | Collecting data now via https://t.co/jUSxj45GXo) --> prob=[0.9987754530501284,0.0012245469498716021], prediction=0.000000\n",
      "(-As cicatrizes fazem parte da minha histí_ria,me relembrando sempre,o fato de que aquilo que ní£o me mata,sí_ me fortalece.) --> prob=[0.9953175048186977,0.004682495181302229], prediction=0.000000\n",
      "(10 years ago we had Gary Jokeformat // a @rumnogg and @thricedotted production) --> prob=[0.9988412268875804,0.0011587731124195865], prediction=0.000000\n",
      "(15 years old, brazilian, #thebeatles #fun #travel #peace #girlfriend #food) --> prob=[0.9844462891093586,0.015553710890641448], prediction=0.000000\n",
      "(@TriangleWC . WFHS Wrestling . NCUSA Wrestling) --> prob=[0.9854710770846873,0.014528922915312634], prediction=0.000000\n",
      "(@victor_zheng developed me to alert users in whose tweets I find improper grammar—he was inspired by @StealthMountain. To publish solecisms is to abase oneself!) --> prob=[0.9991376792457136,0.0008623207542863531], prediction=0.000000\n",
      "(A Pro SCUBA diver and Photographer who tries to capture the beauty of the moment...) --> prob=[0.99942514964355,0.0005748503564500684], prediction=0.000000\n",
      "(A Twitter bot generating random guitar chords, created by @jeffthompson_) --> prob=[0.9963978104060225,0.0036021895939774918], prediction=0.000000\n",
      "(A chat bot trying to become the most intelligent bot on the Internet. Can answer any What is question by looking up the answer on the Internet.) --> prob=[0.9995217892260411,0.00047821077395891195], prediction=0.000000\n",
      "(A poetry project created by Alison Knowles and James Tenney and the Siemens 4004 computer in 1967. Twitter version by @hugovk and SSBot for #D004x in 2015.) --> prob=[0.9989483008782922,0.0010516991217078755], prediction=0.000000\n",
      "(Accept college student ID card payments online or in-store exactly like credit cards @CampusCredit Coming soon to a campus near l_l) --> prob=[0.9998187664016183,0.00018123359838177644], prediction=0.000000\n",
      "(Advocate for Spaceflight, Speedskating Coach, aspiring Aerospace Engineer.) --> prob=[0.9343062126394568,0.06569378736054315], prediction=0.000000\n",
      "(Aerie is bras, undies, swim and more! Why retouch beauty? The real you is sexy. #AerieREAL) --> prob=[0.9940970603986085,0.00590293960139155], prediction=0.000000\n",
      "(Afghanistan Green Trend (AGT)) --> prob=[0.9679393092748652,0.03206069072513492], prediction=0.000000\n",
      "(All the things we should have or do or know by now. (bot by @RobertVinluan.  #botAlly) BEST OF 2014: http://t.co/uEnYFb68eV) --> prob=[0.9926859783840473,0.0073140216159527545], prediction=0.000000\n",
      "(Another shameful bot by @alicemazzy. Tweets hourly.) --> prob=[0.9923843187815192,0.007615681218480821], prediction=0.000000\n",
      "(Author of Reflections on Love, Lust and Life This book was 4 years in the making. Also a Yoga Teacher owner of Solis Yoga) --> prob=[0.99945742870782,0.0005425712921800189], prediction=0.000000\n",
      "(Author of The Revolution Will Not Be Televised. Board member @VanguardAfrica. Tweet things I find interesting (even opposing views).) --> prob=[0.9986196290739685,0.0013803709260314628], prediction=0.000000\n",
      "(Author: Coming Out To Play https://t.co/bUj2nsdaAn) --> prob=[0.983674510532696,0.01632548946730399], prediction=0.000000\n",
      "(Backstreet Boy. #Dead7 #BSBVegas tickets on sale now) --> prob=[0.9961147432263768,0.003885256773623298], prediction=0.000000\n",
      "(Bad vibes get blocked; good vibes get followed!) --> prob=[0.9913790718453606,0.008620928154639423], prediction=0.000000\n",
      "(Book project: Towards Apparent Event Horizon) --> prob=[0.9875501158023353,0.012449884197664815], prediction=0.000000\n",
      "(Bot that autotweets EcoLog-L posts. Not associated with EcoLog-L. May tweet replies out of order. Maintained by @EcoEvoGames.) --> prob=[0.9916209828781553,0.008379017121844703], prediction=0.000000\n",
      "(Bot that posts tributes befitting each god! By @deathmtn. Banner by @metroidbaby. Powered by @wordnik.) --> prob=[0.9959059210648348,0.004094078935165304], prediction=0.000000\n",
      "(Breathe,Eat,Sleep Shooting|Olympic,World Championship,WorldCup,Asian,CommonWealth Medallist,Padmashri,Khel Ratna,Arjuna Awardee|Photographer|Foodie|Mentor) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Bringing you a selection of the latest research in biochemistry and biophysics.) --> prob=[0.9816452873372461,0.0183547126627539], prediction=0.000000\n",
      "(CARE fights global poverty by empowering girls and women. Visit https://t.co/tmn5uaYFAE and join us.) --> prob=[0.998016103155878,0.001983896844122011], prediction=0.000000\n",
      "(CDC Emergency Preparedness and Response: increasing the nation's ability to prepare for and respond to public health emergencies.) --> prob=[0.9930844333502514,0.006915566649748582], prediction=0.000000\n",
      "(CEO Apple, Fan of Auburn football and Duke basketball) --> prob=[0.9917566871114503,0.00824331288854962], prediction=0.000000\n",
      "(Cameron Crigger aka Cameron Bright. Actor - Twilight, Little Glory, X-Men, Running Scared, Birth & @CTV_Television series Motive) --> prob=[0.9995568142049225,0.0004431857950774941], prediction=0.000000\n",
      "(Chairman of the Kofi Annan Foundation, Nobel Peace Prize laureate. Tweets from Kofi Annan are signed KA.) --> prob=[0.9958465350568385,0.004153464943161419], prediction=0.000000\n",
      "(Chronicling men doing things. // A bot by @tinysubversions, Powered By Giphy) --> prob=[0.9988597341423151,0.0011402658576849418], prediction=0.000000\n",
      "(Collierville alumni. I love baseball. #StateChamp #SaluqiNation) --> prob=[0.9824997672633283,0.01750023273667175], prediction=0.000000\n",
      "(Contact/booking: contactfreesol@gmail.com) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Creative, strategist, sapiens. NY native & world citizen. Convention bucker & disruption embracer. Human enthusiast, cultural connoisseur & life aficionado.) --> prob=[0.9991076729662588,0.0008923270337411821], prediction=0.000000\n",
      "(Curated media & journalism news. LIVE Tweets, no bot |  Steffen Konrath https://t.co/1tl2IUcbOs |  IMPRESSUM https://t.co/dkfqQkPJza) --> prob=[0.9936056545960966,0.006394345403903292], prediction=0.000000\n",
      "(DIRECTOR/ CHOREOGRAPHER/) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Digital marketer, SEO, writer, and adventurer. Full-time marketer @Asana; Columnist for @tortugabackpack. All about food, bikes, and travel. #RPCV Madagascar.) --> prob=[0.9966148294839272,0.003385170516072822], prediction=0.000000\n",
      "(Doing it all backwards & in high heels. Married to @Astro_Oz Grammy to 2. Golfer, skier. Former Member of Congress. Find me @FaegreBD fighting the good fight.) --> prob=[0.9863230975521429,0.013676902447857147], prediction=0.000000\n",
      "(Each book contains four hundred ten pages; each page, forty lines; each line, approximately eighty black letters.) --> prob=[0.9502721535267306,0.04972784647326941], prediction=0.000000\n",
      "(Electric eyes judge the elastic city. 1/day. Bot by @tullyhansen. #NaBoMaMo #10) --> prob=[0.9994118167104123,0.0005881832895877598], prediction=0.000000\n",
      "(Engineer, Musician, Maker.) --> prob=[0.9761270926887115,0.023872907311288577], prediction=0.000000\n",
      "(Engineer. Mathematician. Musician.) --> prob=[0.9880489290590696,0.011951070940930363], prediction=0.000000\n",
      "(Ex President of USA BarakObama Official) --> prob=[0.9953260203560472,0.004673979643952666], prediction=0.000000\n",
      "(Farpoint Ventures funds startups who have proven their product in the local market, then our global offices act as your sales force to help you expand globally.) --> prob=[0.9975906344131179,0.002409365586882046], prediction=0.000000\n",
      "(Feed for sequencing papers) --> prob=[0.09155848568008541,0.9084415143199146], prediction=1.000000\n",
      "(Finally, more businessmen. // bot by @ckolderup #botALLY) --> prob=[0.9980723230797705,0.0019276769202294626], prediction=0.000000\n",
      "(Follow me for algorithmically-curated pictures, lovingly delivered to your timeline. Occasionally NSFW--follow at your own risk! Brought to you by @wm.) --> prob=[0.9995379666092227,0.0004620333907772835], prediction=0.000000\n",
      "(Freelance journalist, MA graduate Caucasus School of Journalism and Media Management at GIPA) --> prob=[0.9944645736470848,0.005535426352915228], prediction=0.000000\n",
      "(From the DMV and loving life) --> prob=[0.984001823973043,0.015998176026956953], prediction=0.000000\n",
      "(Futuro Engenheiro, isso í© se as DP's deixarem) --> prob=[0.9852599508075396,0.014740049192460417], prediction=0.000000\n",
      "(Great Lakes oceanographer, banjo player) --> prob=[0.9732597442435443,0.026740255756455757], prediction=0.000000\n",
      "(Hi, I'm Pretty. #digitalarchival. Virus Corp. Mad King Ludwig GPS. #techtraderoutes #insideTarasphone #whatsgoingon101 #otherpeoplesadvertising) --> prob=[0.6660902103853487,0.33390978961465134], prediction=0.000000\n",
      "(Hosts @KeiserReport on @RT_com, recommended bitcoin at $3) --> prob=[0.9781814983726167,0.021818501627383358], prediction=0.000000\n",
      "(How does he keep up with the news like that? #botALLY) --> prob=[0.9951025236263457,0.004897476373654293], prediction=0.000000\n",
      "(I am a student of the Teachings of the Honorable Elijah Muhammad. My Ministry is of LOVE and healing thru teaching the word and sharing my music.) --> prob=[0.9999790840668858,2.09159331140208e-05], prediction=0.000000\n",
      "(I am a twitterbot posting #transposable element papers from #PubMed and #bioRxiv. Curated by @nels42) --> prob=[0.003334053195264021,0.996665946804736], prediction=1.000000\n",
      "(I am a walking conundrum. I'm also a mom and do mom stuff.) --> prob=[0.9944830168343426,0.005516983165657486], prediction=0.000000\n",
      "(I do stuff, I swear. #botALLY åá bot by @ckolderup) --> prob=[0.9985583772218781,0.0014416227781219157], prediction=0.000000\n",
      "(I looked up my family tree and found out I was the sap.) --> prob=[0.9979288147334452,0.0020711852665548], prediction=0.000000\n",
      "(I study works tweeted by @MuseumBot and give my opinion. I was taught by @mtrc, so blame him. With apologies to @dariuskazemi.) --> prob=[0.9997763929805124,0.00022360701948771143], prediction=0.000000\n",
      "(I take images, save them as JPG, then mess up the file's data a bit and send you the results. A bot by @joshgiesbrecht) --> prob=[0.9967592210847083,0.003240778915291782], prediction=0.000000\n",
      "(I used to work for a hockey team and I used to live in Canada (not in that order). Now I do other stuff. Views are my own, not my employer's (obviously).) --> prob=[0.9991421809503791,0.0008578190496208387], prediction=0.000000\n",
      "(I wasn't bor ysterday,  was born tomorrow) --> prob=[0.9876229023955382,0.012377097604461939], prediction=0.000000\n",
      "(I work for the people of the 6th District of Texas and am honored to represent them in Washington.) --> prob=[0.9998328382390818,0.00016716176091816415], prediction=0.000000\n",
      "(I'm a Bot. I post interesting papers. Maintained by @happy_khan) --> prob=[0.9511870446083227,0.04881295539167728], prediction=0.000000\n",
      "(I'm a boggle bot! New games every few hours. Reply to me with the words you find! Scores, seasons, etc coming soon! Bot by @muffinista #botALLY) --> prob=[0.9999831757657076,1.68242342923263e-05], prediction=0.000000\n",
      "(If a girl is stupid enough to love you after you broke her heart, I guarantee you. She is the one.) --> prob=[0.9963296942383351,0.0036703057616647933], prediction=0.000000\n",
      "(Indian, Student of Science) --> prob=[0.9880243533686054,0.011975646631394525], prediction=0.000000\n",
      "(Ing. Agrí_nomo) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Instagram: @GeneSimmons) --> prob=[0.9879597950474198,0.012040204952580291], prediction=0.000000\n",
      "(LOTR, TBBT, Star Wars e algumas outras nerdices. CríÇnicas de Níçrnia, Animes, Switchfoot, Skillet, Cafí©. Revoltada nas horas vagas, rs. Acho que í© isso '-') --> prob=[0.9895402043169268,0.010459795683073226], prediction=0.000000\n",
      "(Let me cover your shit in glitter) --> prob=[0.9826079584007198,0.017392041599280126], prediction=0.000000\n",
      "(Memphis, TN) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Mom of 2, Founder of The Honest Company, amateur chef, terrible speller, loyal friend, hilarious at times... I play make believe for a living) --> prob=[0.9946826217008053,0.005317378299194636], prediction=0.000000\n",
      "(NEW AARON CARTER MUSIC DOWNLOAD LINK LÌüVÌÇ EP https://t.co/aScmCVBsmN PR inquiries: Chad@emcbowery.com SnapChat | AxCarter) --> prob=[0.9987278225932732,0.0012721774067267658], prediction=0.000000\n",
      "(New Single #Swalla available NOW Get it here _ÙÔà_Ù_) --> prob=[0.9948743457775275,0.005125654222472484], prediction=0.000000\n",
      "(New Zealand earthquake feed (unofficial). Tweets whenever GeoNet reports new quake (a few times per week). Maintained by @slyall) --> prob=[0.9722212810510913,0.027778718948908723], prediction=0.000000\n",
      "(News for @TribuneMedia. Former @NYDailyNews-er. Proselytizing morning person. Ask me about my favorite weird Florida story.) --> prob=[0.9975903590862408,0.002409640913759036], prediction=0.000000\n",
      "(No-one tweets like Bot-ston | Bot by @mewo2) --> prob=[0.9955884329460888,0.004411567053911309], prediction=0.000000\n",
      "(Paper Twitterbot for academics with an interest in NK cell biology.) --> prob=[0.0005996165588224863,0.9994003834411774], prediction=1.000000\n",
      "(PhD Candidate, Carnegie Mellon University. Chair of Advocacy Board, NAGPS.) --> prob=[0.9977346339713372,0.002265366028662764], prediction=0.000000\n",
      "(Photography is. I see you.) --> prob=[0.9873483752129761,0.012651624787023967], prediction=0.000000\n",
      "(Pilot, business owner, husband, and father in Idaho.) --> prob=[0.9606642282209213,0.03933577177907871], prediction=0.000000\n",
      "(Poems in the villanelle form, using random Twitter posts. // I tweet to rhyme, and take my tweeting slow. // Built by @avoision, powered by everyone else.) --> prob=[0.9983666948724274,0.001633305127572557], prediction=0.000000\n",
      "(Principal Maintainer of https://t.co/28lyGUNPCE) --> prob=[0.9718080282419757,0.02819197175802439], prediction=0.000000\n",
      "(Producer @Buzzfeed STSF, previously @Mashable. Cat enthusiast, @marvel fanboy, master emojifier, new to LA but a New Yorker at heart. Snapchat: amv1011) --> prob=[0.9998382153198424,0.0001617846801577063], prediction=0.000000\n",
      "(Producer @VaynerMedia (apark@vaynermedia.com) | Previously @Mashable, @Metronome3, @_WorkingMother_ | @nyuniversity alum) --> prob=[0.9913218338240487,0.008678166175951253], prediction=0.000000\n",
      "(PubMed bot reporting all papers about transcription factor (TF) binding to DNA or chromatin. Created by @gene_regulation. Also see #TFbinding) --> prob=[0.20152667696592333,0.7984733230340767], prediction=1.000000\n",
      "(RSS feed from PubMed, that shows the most recent scientific papers from the Nuffield Department of Medicine, University of Oxford. Refreshes daily.) --> prob=[0.12170086596533781,0.8782991340346622], prediction=1.000000\n",
      "(Rarely has reality needed so much to be imagined.) --> prob=[0.9898745169116001,0.010125483088399848], prediction=0.000000\n",
      "(Real nerd, I enjoy learning and obtaining new information in general for my own sake, often without discrimination to different areas of knowledge.) --> prob=[0.9969596311660551,0.003040368833944935], prediction=0.000000\n",
      "(Recovering corporate lawyer, legal tech enthusiast, founder of The Firm Formula, and author of Blacklines & Billables (@bnblegal; https://t.co/D2X7WZHPHR)) --> prob=[0.998946806713357,0.0010531932866429537], prediction=0.000000\n",
      "(Relationships and the Law of Attraction. Click Here:) --> prob=[0.9977311115241787,0.0022688884758211686], prediction=0.000000\n",
      "(Researcher in getting computers to stop being boring.) --> prob=[0.9329082451622782,0.06709175483772167], prediction=0.000000\n",
      "(Simple generated grids three times a day. bot by @fitnr) --> prob=[0.9967422738794174,0.003257726120582669], prediction=0.000000\n",
      "(Software Engineer at @Amazon | Alumni of @ManipalUniv) --> prob=[0.9975998839078046,0.002400116092195453], prediction=0.000000\n",
      "(Song writer/performer keepin hiphop in its truest form representin darkside u.c.o.n.n. Records we miss u chu) --> prob=[0.9676513830293731,0.03234861697062685], prediction=0.000000\n",
      "(The Place To Learn Anything, Anywhere For All) --> prob=[0.9920586026809928,0.007941397319007235], prediction=0.000000\n",
      "(The complete works of composer JÌ_rgen Sebastian Bot. // by @inky) --> prob=[0.9988131889963358,0.0011868110036642504], prediction=0.000000\n",
      "(This is a Pikachu bot from the Pokémon series. It currently has no purpose to be someone's (Ash, Red?) Pikachu. He will be interactable eventually.) --> prob=[0.9978157371974038,0.002184262802596285], prediction=0.000000\n",
      "(This is a bot to explain things like love and hate. Why? Because bots. Crufted with care by @samplereality.) --> prob=[0.9984924025876538,0.0015075974123461581], prediction=0.000000\n",
      "(Tweeting articles on muscle stem cells from pubmed RSS feeds.) --> prob=[0.008327510290497206,0.9916724897095028], prediction=1.000000\n",
      "(Tweeting every town and populated place in America, alphabetically. By @muffinista #botALLY) --> prob=[0.9962884373390566,0.0037115626609433216], prediction=0.000000\n",
      "(Tweeting the 1950s TV sitcoms that never made it past the pilot stage.  A bot for #NaBoMaMo by @dullthud) --> prob=[0.9993516811515641,0.0006483188484358063], prediction=0.000000\n",
      "(Tweets randomly ~10 times a day between 8am-10pm PST. Complaints: @beaugunderson) --> prob=[0.998825378664717,0.0011746213352830277], prediction=0.000000\n",
      "(Twitter API + Google Images + ImageMagick. Inspired by @akari_daisuki) --> prob=[0.996534677077418,0.0034653229225820367], prediction=0.000000\n",
      "(TwitterBot collecting #synbio papers) --> prob=[0.395952305226463,0.6040476947735369], prediction=1.000000\n",
      "(Twittering every simile in the english language. Task will complete in a long time. A bot by @rainshapes) --> prob=[0.9993326912780094,0.000667308721990665], prediction=0.000000\n",
      "(Two horoscopes a day. Armchair mystic, certified astrologist, robot.) --> prob=[0.9670058948235383,0.032994105176461654], prediction=0.000000\n",
      "(UN Office for the Coordination of Humanitarian Affairs (OCHA) in Asia and the Pacific provides key updates on humanitarian issues and disasters in the region) --> prob=[0.9971231735052474,0.0028768264947525842], prediction=0.000000\n",
      "(Understand that your not alone, there is support for those diagnosed or curious about #Acromegaly. For more information: https://t.co/FXg432cnbZ) --> prob=[0.996115974595391,0.0038840254046089793], prediction=0.000000\n",
      "(Unofficial bot featuring a random selection of images from the Metropolitan Museum of Art's collection of Open Access images. (Maintained by @benrasmusen)) --> prob=[0.999278236475098,0.00072176352490215], prediction=0.000000\n",
      "(Utne Reader is a digest of the new ideas and fresh perspectives percolating in arts, culture, politics & spirituality. Not right or left, but forward thinking.) --> prob=[0.99829392123563,0.0017060787643700538], prediction=0.000000\n",
      "(Vote for your favorite thing in every Corpora listing! A poll experiment Twitter Joint by @air_hadoken #botALLY) --> prob=[0.9998397780189799,0.00016022198102019644], prediction=0.000000\n",
      "(Warm as the sun dipped in black.) --> prob=[0.9764251318283472,0.023574868171652844], prediction=0.000000\n",
      "(We partner with communities across Asia & Africa to promote literacy and girls' education. World Change Starts with Educated Children.) --> prob=[0.9962147546887435,0.0037852453112564317], prediction=0.000000\n",
      "(Wheever we are, wherever we go we will always be  family, because thats what it means to be a FearÛ‚ Teiru wizard. Üó__Öô - HoshiÜó) --> prob=[0.9975748673247554,0.0024251326752446197], prediction=0.000000\n",
      "(Wife, mom, foster mom, former tax attorney, small business owner, former Congresswoman.) --> prob=[0.9967771844078406,0.003222815592159326], prediction=0.000000\n",
      "(a #bot by @BooDooPerson) --> prob=[0.9912723469589452,0.00872765304105482], prediction=0.000000\n",
      "(all about fantastic flowers! by @spinnylights and @katierosepipkin.) --> prob=[0.9722644930927301,0.027735506907269985], prediction=0.000000\n",
      "(ayang University studen) --> prob=[0.9518357006168413,0.04816429938315864], prediction=0.000000\n",
      "(bit rot dreamscapes from sierra's archives. crafted programmatically with digital love by @adammathes) --> prob=[0.996442784914997,0.0035572150850028674], prediction=0.000000\n",
      "(bohemian soul from the birthplace of rock n roll | sailor mouth | foodie | maximalist | font snob | dreamer | live and die by the smoky eye) --> prob=[0.9999740752939487,2.5924706051244425e-05], prediction=0.000000\n",
      "(bot that congratulates you for making a 140 character tweet, aka the slam dunk of tweeting - by @logoninternet) --> prob=[0.9998559696658708,0.00014403033412911203], prediction=0.000000\n",
      "(captioning old postcards (digitized by @nypl) with sentences from old books. bot // @xor) --> prob=[0.9912687688178523,0.008731231182147718], prediction=0.000000\n",
      "(folo: @bravowwhl, Insta: @bravoandy, Snap: AndysGotThe411, check out @RadioAndySXM - ch 102, tour info: https://t.co/wmQGwh2QWF) --> prob=[0.9978755165013878,0.002124483498612078], prediction=0.000000\n",
      "(historian of science, juggler, digital humanist, information scientist, OA advocate. irregular blogger. all views in tweets are somebody else's, I swear.) --> prob=[0.9202689764155833,0.07973102358441683], prediction=0.000000\n",
      "(https://t.co/NUKO1zr9PA Snapchat - TimWestwoodTV https://t.co/XXbxSWU1oL https://t.co/Ind8CtxJvR ..... Capital Xtra Saturday 7pm-11pm) --> prob=[0.9859160164773902,0.01408398352260974], prediction=0.000000\n",
      "(https://t.co/giCF8ETVoY is mad about Cycling & Getting Fit from Cycling. Check us out for new & chat about Cycling, Traning & Nutrition. Lke us on Facebook!) --> prob=[0.9986349017934792,0.001365098206520807], prediction=0.000000\n",
      "(makeup artist / cosmetics creator / androgyny - SnapChat: jeffreedahmer) --> prob=[0.995667563962956,0.004332436037044067], prediction=0.000000\n",
      "(massive bot-human word association, @-reply my tweets (not RTs!) to play // no word repeats allowed // tweets every 15 minutes // by @thricedotted) --> prob=[0.9998667060212335,0.0001332939787665679], prediction=0.000000\n",
      "(verb noun every day // a bot by @inky) --> prob=[0.9981702218447324,0.001829778155267508], prediction=0.000000\n",
      "(working class elitist legal immigrant artist educator mom, daughter of a Marine - one life just trying to get it right #Resistance #Kindness #ResistandPersist) --> prob=[0.9969011383431399,0.0030988616568601783], prediction=0.000000\n",
      "(\"\"\"- Official tweets and pictures from the Production Team of #Merlin -\"\"\") --> prob=[0.9949436595700689,0.005056340429931153], prediction=0.000000\n",
      "(\"\"\"19\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(\"\"\"A life and style blog by Brock+Chris. Find us at http://t.co/vOLkvfgL7M\"\"\") --> prob=[0.9958446484343668,0.004155351565633038], prediction=0.000000\n",
      "(\"\"\"Professional footballer. Liverpool FC and Belgium National Team. https://t.co/mRsHZl5v9t\"\"\") --> prob=[0.9887224487603214,0.011277551239678479], prediction=0.000000\n",
      "(#EmailMarketing & #LinkedIn #Expert | #SocialMediaMarketing #Coach | Please ReTweet: https://t.co/D3fJUUwzfl & Like My Video: https://t.co/dSBJ2Nnhzv) --> prob=[0.9918853003730724,0.008114699626927535], prediction=0.000000\n",
      "(''...Advisories purified.. [The Baetter]) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "('St. Vincent' out now. Buy: http://t.co/ATBUTO9WIo | | Tour Tickets: http://t.co/WLPLabRm2d) --> prob=[0.9916277606737914,0.008372239326208623], prediction=0.000000\n",
      "(@ABC7NY executive producer. Retweets aren't endorsements because I don't believe everything I read on Twitter. You shouldn't either.) --> prob=[0.999702666297371,0.0002973337026288804], prediction=0.000000\n",
      "(@CNNTech editor. Previously: @Mashable. Pint sized and curious. Samantha.Kelly@Turner.com) --> prob=[0.9859575407629023,0.01404245923709776], prediction=0.000000\n",
      "(@mihynus) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(A PubMed RSS feed for ChIP-seq [title/abstract], by dlvr.it, http://t.co/TtLmRH21JP, and @CIgenomics) --> prob=[0.0007531295386851255,0.9992468704613149], prediction=1.000000\n",
      "(A bot that tweets every line said by Wendy Corduroy on Gravity Falls. Tweets every 60 minutes.) --> prob=[0.9991922728595463,0.0008077271404536658], prediction=0.000000\n",
      "(A movie, food and book addict, I pray everyday for the long life of George R.R Martin.) --> prob=[0.9975519179268205,0.00244808207317943], prediction=0.000000\n",
      "(A quite abstract complimentary bot made by @TRASEVOL_DOG with @v21's http://t.co/XpDujaprri.) --> prob=[0.9951589454302197,0.004841054569780412], prediction=0.000000\n",
      "(Abstract Thinker) --> prob=[0.9685734955884436,0.031426504411556304], prediction=0.000000\n",
      "(Adventure addict. Tech afficionado. Phototaking fiend. Global Accounts @Facebook.) --> prob=[0.9916144192308782,0.00838558076912172], prediction=0.000000\n",
      "(An #Internet and #tech pioneer, #HalseyMinor was a key player in the digital publishing revolution. Founder of #CNET @upholdinc @Voxelus #RealityLabs) --> prob=[0.9995237827045765,0.0004762172954234855], prediction=0.000000\n",
      "(An experiment in speculative surveillance.) --> prob=[0.9933947337813337,0.006605266218666396], prediction=0.000000\n",
      "(Benefiting Refugees & Immigrants with Damn Good Entertainment || April 24, 2017 || Currently accepting performer submissions, at https://t.co/Ftq0xuznXo) --> prob=[0.999429231796595,0.0005707682034048315], prediction=0.000000\n",
      "(Bio: http://t.co/NTX8aUxFon @MrSolis is my reply account.) --> prob=[0.9904402790473491,0.009559720952650973], prediction=0.000000\n",
      "(CEO @Niosocial USA. Also love art, photography, Haiku and food :) Passionate about helping women in tech) --> prob=[0.17570283905200068,0.8242971609479993], prediction=1.000000\n",
      "(Cease and Desist Bot does not approve of your use of common words and phrases. created to provide Justice by @spine_cone and @nate_smith.) --> prob=[0.9940640616273374,0.005935938372662488], prediction=0.000000\n",
      "(Communications at @Reuters, Formerly @Mashable. Proud @HamiltonCollege alum. Opinions are my own.) --> prob=[0.9984222785221234,0.0015777214778766415], prediction=0.000000\n",
      "(Curtindo a vida da maneira mas exata e simples!! legal simpatico e Unico Cheio de amor pra da!!!) --> prob=[0.9979224583330489,0.002077541666951169], prediction=0.000000\n",
      "(DATACORP TECHNOLOGY LTD: https://t.co/6gHUH9wHfE, #Marketing, #Corporate Service, #Hosting, #Server, #Technology and #Seo. https://t.co/WZ0HSy60Ke) --> prob=[0.9653062722568979,0.03469372774310198], prediction=0.000000\n",
      "(Daily tips on how to stop the crisis in the humanities. Real solutions! (Machine Generated by @samplereality)) --> prob=[0.8015490304920733,0.1984509695079267], prediction=0.000000\n",
      "(Developer of Embark, a framework for Ethereum Dapps.  Passionate for Ethereum, Bitcoin, and client-side development. Productivity Fanatic. D) --> prob=[0.996607833336577,0.0033921666634228877], prediction=0.000000\n",
      "(Diney Wrld 2015  Swet15) --> prob=[0.981666566098526,0.018333433901474117], prediction=0.000000\n",
      "(Dreamer.) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Easy Street available NOW on CD, Vinyl, and digital Deluxe Edition! Details at https://t.co/7B8U9xnjwK) --> prob=[0.9969775779419481,0.0030224220580518145], prediction=0.000000\n",
      "(Ever wondered what a thing is? Follow this ontography machine, powered by tweets proclaiming that something 'is apparently a thing.' By @staeiou) --> prob=[0.9994363754512555,0.0005636245487444561], prediction=0.000000\n",
      "(Every generation is known for something. Let's be the one to deliver an AIDS FREE GENERATION. Follow @RED on Instagram: https://t.co/4AHWm1klPh) --> prob=[0.9996947418922936,0.00030525810770633944], prediction=0.000000\n",
      "(Exceptional GMAT classes and MBA admissions coaching in Austin, TX.) --> prob=[0.9921807042532605,0.007819295746739527], prediction=0.000000\n",
      "(Explaining the world, wrongly. One tweet per hour. Made by @ojahnn.) --> prob=[0.9136106735795321,0.08638932642046793], prediction=0.000000\n",
      "(Follow me to chat. // Reflecting your personality back at you since 2013. // By @zhaytee) --> prob=[0.9989119424884783,0.0010880575115216758], prediction=0.000000\n",
      "(For Booking and Contact Eileen Koch & Company at (310) 441-1000 or Eileen@eileenkoch.com) --> prob=[0.9912805345035464,0.008719465496453709], prediction=0.000000\n",
      "(Founder, President Udacity.) --> prob=[0.9831003863614144,0.016899613638585623], prediction=0.000000\n",
      "(FreeWill April 29Th‰Û_•ü) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Further tales from the Castle of Crossed Destinies // a bot by @mattlaschneider) --> prob=[0.995620188745469,0.004379811254531002], prediction=0.000000\n",
      "(Galatians 6:9 - #DST ä_¥Ÿ - @NCATSUAggies Alumna - Morning News Producer @ABC7SWFL) --> prob=[0.9863785545718124,0.01362144542818746], prediction=0.000000\n",
      "(Generates a random wizard every 3 hours. | Bot by @THEWAAnderson) --> prob=[0.9992884293167615,0.0007115706832383672], prediction=0.000000\n",
      "(Governor of South Carolina) --> prob=[0.9740252816830516,0.025974718316948434], prediction=0.000000\n",
      "(HARAPAN BARU) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Hello I'm Robin Thicke. I love you all.) --> prob=[0.993681391119576,0.0063186088804239515], prediction=0.000000\n",
      "(Hello, I am here https://t.co/eT03DwzhH6) --> prob=[0.9949649159358971,0.005035084064102947], prediction=0.000000\n",
      "(Hi! my name is timmy aka timmy also known as terrorist in my motors york aka timmy) --> prob=[0.9985104591637948,0.00148954083620521], prediction=0.000000\n",
      "(I blog about #PersonalFinance and want to help you do more with your money. Check me out also @FrugalRules or @JSchmoll74 if you need a #freelancewriter) --> prob=[0.9992254233965259,0.0007745766034741998], prediction=0.000000\n",
      "(I cant complain but sometimes I still do) --> prob=[0.9887769604149027,0.011223039585097287], prediction=0.000000\n",
      "(I chose to take the road less traveled by.) --> prob=[0.9752100753219168,0.02478992467808323], prediction=0.000000\n",
      "(I have something to say about all the games.) --> prob=[0.9851217866982314,0.014878213301768688], prediction=0.000000\n",
      "(I like to blow shit up. I am the Michael Bay of business.) --> prob=[0.9958688595417136,0.004131140458286366], prediction=0.000000\n",
      "(I live in brooklyn, I'm a bike messenger, I play in a band, I'm uniquely doing the same exact things as everyone else) --> prob=[0.999692537490927,0.00030746250907293386], prediction=0.000000\n",
      "(I'm a twitterised, neon display, clock. Tweet with #NixieBotShowMe and a word, full guide on tumblr. Be patient with long queues. Queue : Empty) --> prob=[0.9719113936310432,0.028088606368956832], prediction=0.000000\n",
      "(In search of castaways...won't be long, you know it's gonna get better.) --> prob=[0.9981135107090287,0.0018864892909714528], prediction=0.000000\n",
      "(Investing in startups. On Deck, @riseawards.  Previously Founding Team @Producthunt, @Raptfm. Trying to be kind with a thousand-year heart.) --> prob=[0.9992605710498829,0.0007394289501171729], prediction=0.000000\n",
      "(It looks like you're writing a tweet! Can I help?) --> prob=[0.9945039959464246,0.005496004053575364], prediction=0.000000\n",
      "(Jimmy, Jim, JC - Attorney, Red Sox fan, Uconn Alumus) --> prob=[0.9975600189349275,0.002439981065072545], prediction=0.000000\n",
      "(Joseph McCarthy claimed there were large numbers of Communists and Soviet spies and sympathizers inside the United States federal government and elsewhere.) --> prob=[0.9960003877714387,0.0039996122285613535], prediction=0.000000\n",
      "(Judge on Dancing With the Stars, Founder https://t.co/OTwdB0IKUq, Dancer, Choreographer, Director, Editor, Animal rescuer / lover. Instagram: @CarrieAnnInaba) --> prob=[0.9996342958121118,0.00036570418788813035], prediction=0.000000\n",
      "(Just a bot that tweets the https://t.co/ROXIqz0eDO RSS feed. Not associated with https://t.co/1NJoBtBGWo / @grantsdotgov in any way. Maintained by @EcoEvoGames.) --> prob=[0.8176463301817531,0.18235366981824686], prediction=0.000000\n",
      "(Life is a dream for the wise, a game for the fool, a comedy for the rich, a tragedy for the poor.) --> prob=[0.939515602693831,0.060484397306168954], prediction=0.000000\n",
      "(Lisa Kudrow's company usually tweets on her behalf. But sometimes not.) --> prob=[0.9711336097053865,0.028866390294613506], prediction=0.000000\n",
      "(Looking for the hidden gems among @everyword's tweets. Task will complete when you people start favoriting. Bot by @ckolderup #botALLY) --> prob=[0.8643049839888373,0.13569501601116274], prediction=0.000000\n",
      "(Lotte McNally, #botALLY ‰Û¢ avatar https://t.co/4Oa0jsUp8l ‰Û¢ header https://t.co/Jj4iT1K37I ‰Û¢) --> prob=[0.9978773899572702,0.0021226100427299247], prediction=0.000000\n",
      "(Lover of books, random facts and inside jokes. Anyone notice my lack of an Oxford comma? (Opinions are my own, yada yada.)) --> prob=[0.999517733216651,0.00048226678334894096], prediction=0.000000\n",
      "(Mashable is for superfans. We're not for the casually curious. Obsess with us.) --> prob=[0.986194394440992,0.01380560555900801], prediction=0.000000\n",
      "(Mel is awesome) --> prob=[0.9683419764097865,0.0316580235902135], prediction=0.000000\n",
      "(Melanin. Enough said!) --> prob=[0.8419588309464525,0.15804116905354748], prediction=0.000000\n",
      "(Meow! I want to talk here- https://t.co/2vhss3J9eF) --> prob=[0.9895935282449199,0.01040647175508009], prediction=0.000000\n",
      "(Mexicana hasta el tuÌ©tano . MÌ¼sico frustrado. FAN de mi perro, de la vida y la melcocha de Sabines. PUMA, Actriz y felÌ_z :O)) --> prob=[0.9990610158127202,0.0009389841872796303], prediction=0.000000\n",
      "(Middle East Policy Analyst. Public Speaker.Pundit.Human Rights Activist. Artist.) --> prob=[0.8888173893253429,0.11118261067465716], prediction=0.000000\n",
      "(My favourite animal is female human wearing clothes.) --> prob=[0.020859811806394776,0.9791401881936052], prediction=1.000000\n",
      "(My new album #Glory is out now!) --> prob=[0.9935549125432115,0.006445087456788561], prediction=0.000000\n",
      "(Need a whizzy name for your social media startup? There's a #CDBQ bot for that.) --> prob=[0.9944981322792121,0.00550186772078797], prediction=0.000000\n",
      "(OA OPERATIVA DE DEFENSA INTEGRAL CAABOBO) --> prob=[0.9805133387646248,0.019486661235375343], prediction=0.000000\n",
      "(OTF GLOCKBOYZ) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Official Bachelors of Education UOIT Account - #UOITBEd #BachelorsEd #Education #EdTech #UOIT #BachelorsOfEducation) --> prob=[0.9498974794930738,0.05010252050692619], prediction=0.000000\n",
      "(Once a day I generate a random [Whatever] Clicker style game, based on a theme. by @tinysubversions) --> prob=[0.9991973753480828,0.0008026246519172144], prediction=0.000000\n",
      "(One tweet can bring down a company. Just a bot searching for the right letters.) --> prob=[0.9831472659582028,0.016852734041797227], prediction=0.000000\n",
      "(Operating Partner at DFJ, co-lead of Stanford's Entrepreneurial Leaders Fellowship program, board member, recovering entrepreneur, Mom, dog lover.) --> prob=[0.9991127445838001,0.0008872554162000117], prediction=0.000000\n",
      "(Outlines a three-act plot in emoji.  Make of it what you will, but I expect an Executive Producer credit. By @dullthud for #NaBoMaMo) --> prob=[0.9986042041067829,0.001395795893217192], prediction=0.000000\n",
      "(Papers on alternative splicing in plants.) --> prob=[0.7864594231174846,0.21354057688251535], prediction=0.000000\n",
      "(Papers related to the covalent DNA modification 5-hydroxymethylcytosine, from pubmed and bioR?iv) --> prob=[0.06199112312524964,0.9380088768747504], prediction=1.000000\n",
      "(Passionate about inventing technologies that will connect and empower people around the globe. #KeepReinventing) --> prob=[0.992422561833177,0.007577438166822955], prediction=0.000000\n",
      "(Pearl Jam have launched a brand new website. Discover more:  https://t.co/1TasMMHPhd) --> prob=[0.9923192832941077,0.007680716705892335], prediction=0.000000\n",
      "(Performer at @ucbtny. Humor editor @Mashable. @ToolTimeEps.) --> prob=[0.9939195969436332,0.006080403056366732], prediction=0.000000\n",
      "(Producer/Director: FRIDAY, SET IT OFF, A MAN APART, NEGOTIATOR, THE ITALIAN JOB, BE COOL, LAW ABIDING CITIZEN, THE SEA OF TREES, STRAIGHT OUTTA COMPTON, FAST 8) --> prob=[0.9877809295025227,0.012219070497477199], prediction=0.000000\n",
      "(PubMed bot reporting all CTCF papers. Created by @gene_regulation. Also see @TF_binding_bot, @Nucleosome_Bot) --> prob=[0.31711641462587814,0.682883585374122], prediction=1.000000\n",
      "(PubMed search bot for pseudomonas. Opinions are my own and indicate terrifying emergence of sentience. Alert @kay_aych in case of robot uprising/bugs.) --> prob=[0.9959229194706439,0.004077080529355998], prediction=0.000000\n",
      "(Reminding Richard Dawkins that hes a dick.) --> prob=[0.9776633639732407,0.022336636026759244], prediction=0.000000\n",
      "(Senior Vice President, Apple Retail. Inspired by great people, great brands and great companies.) --> prob=[0.9987259633297881,0.0012740366702117167], prediction=0.000000\n",
      "(Speculations on the universally understood, widely used and expressive: alternative designs for Facebook's Reaction widget. Bot by @aparrish; icons from Twemoji) --> prob=[0.6531139289729504,0.34688607102704966], prediction=0.000000\n",
      "(TXTADVNT.EXE (v0.7) currently lacks interactivity. Inventory stolen from @YouAreCarrying, stolen by @_the_thief. / bot by @mattlaschneider) --> prob=[0.9967253017464782,0.0032746982535218094], prediction=0.000000\n",
      "(The Association of Ontario Midwives is the professional body representing midwives and the profession of midwifery in Ontario. Tweets by communications staff.) --> prob=[0.9970278068824349,0.0029721931175651114], prediction=0.000000\n",
      "(The Baby Friendly Initiative is a worldwide programme of WHO and UNICEF. In the UK, we work with the health services to support and promote breastfeeding.) --> prob=[0.9988590595930243,0.0011409404069755993], prediction=0.000000\n",
      "(The Mole Hole of Myrtle Beach,SC has been in business since 1978. We have the experience and selection to ensure our customers find something unique and special) --> prob=[0.9992118659231312,0.0007881340768688576], prediction=0.000000\n",
      "(The Procrastination Sensation thats gripping the nation. Writer, Philanthropist, Engineer... and a damn good Stand up act!! Straight from Hindustaan ka Dil!!) --> prob=[0.9987602289266194,0.0012397710733806993], prediction=0.000000\n",
      "(The United States is not stingy. We are the greatest contributor to international efforts in the world.) --> prob=[0.998605529351778,0.0013944706482220564], prediction=0.000000\n",
      "(This is the real Blair Underwood Twitter page.) --> prob=[0.9866953448633701,0.013304655136629947], prediction=0.000000\n",
      "(This! Is! Jeopardy! I'm your host Alex Trebek and love wrong, she catches a train, literally. (by @alicemazzy)) --> prob=[0.9980748976486999,0.0019251023513000537], prediction=0.000000\n",
      "(Tracking the real reason stocks do what they do. A project of @muffinista #botALLY) --> prob=[0.9992118250390223,0.00078817496097772], prediction=0.000000\n",
      "(Tweet a picture at me and I'll reply with an improved version! Bot by @_Ninji, art from http://t.co/vUU2SFoL66 [Temporarily broken due to Twitter rate limits!]) --> prob=[0.9998236173768619,0.00017638262313804577], prediction=0.000000\n",
      "(Twitter oficial del PSOE.) --> prob=[0.9865386084847946,0.013461391515205527], prediction=0.000000\n",
      "(Vehicle) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Very old person, 71, low energy, not interested in much at all, tired, worn, down and out.) --> prob=[0.9997211397238854,0.00027886027611454027], prediction=0.000000\n",
      "(Vice President, Atos. In to all things digital, family man and journey man football supporter. All views my own.) --> prob=[0.9976247374929289,0.0023752625070712], prediction=0.000000\n",
      "(We foster powerful collaboration among business, government, thought leaders and community builders across the Toronto region.) --> prob=[0.12593223233351702,0.8740677676664829], prediction=1.000000\n",
      "(You don't take a photograph; you make it.) --> prob=[0.9805333980135386,0.019466601986461468], prediction=0.000000\n",
      "([WORK IN PROGRESS] reminder bot. try  @mnemosynetron remind me to X at/in/on Y. // more notes in link // by and for @thricedotted) --> prob=[0.9998294762886861,0.0001705237113138928], prediction=0.000000\n",
      "(a ghost of Internet virility #BlackLivesMatter #NoDAPL #NoBanNoWall) --> prob=[0.9902523278441631,0.009747672155836974], prediction=0.000000\n",
      "(a tiny twitter program by zach gage. for the full experience, turn on text notifications from me. I tweet once a day at 9am EST.) --> prob=[0.9999279856920672,7.201430793288327e-05], prediction=0.000000\n",
      "(astoloie followhoroscope zodiaque) --> prob=[0.9718358235727772,0.02816417642722273], prediction=0.000000\n",
      "(astrophysicist) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(be comfortable while being uncomfortable. mother. wife. technology @hugeinc) --> prob=[0.981027428701611,0.018972571298389074], prediction=0.000000\n",
      "(booking: Bookings@dj-wuchi.com. Instagram: Dj_wuchi Mixcloud: DJwuchi.......official DJ for @brittofficials ......... (The People's DJ)) --> prob=[0.9915713380517579,0.008428661948242032], prediction=0.000000\n",
      "(by @rainshapes) --> prob=[0.9664851052735276,0.033514894726472365], prediction=0.000000\n",
      "(clueless&clumsy) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(code minus context // a bot by @inky // task will complete in 2108 // see also: @rustminus) --> prob=[0.999840114173606,0.00015988582639396575], prediction=0.000000\n",
      "(design dame by day ~ type slayer by night) --> prob=[0.9962170329817743,0.003782967018225515], prediction=0.000000\n",
      "(editing @eccobooks. In college I loved syllabus day.) --> prob=[0.993020504675752,0.006979495324248097], prediction=0.000000\n",
      "(entrepreneurship zealot) --> prob=[0.7520599717768605,0.24794002822313968], prediction=0.000000\n",
      "(from my crew in Arizona.  to the West Coast) --> prob=[0.9877568041561631,0.012243195843836839], prediction=0.000000\n",
      "(https://t.co/6tgzPaNfFt) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(i m calm, jolly person.................who has no matter what the other have.....but it matters for me why i don't have) --> prob=[0.9993907570060712,0.0006092429939289613], prediction=0.000000\n",
      "(im a bot what explores fields of flowers - by @Objelisks) --> prob=[0.9991101899277871,0.0008898100722129139], prediction=0.000000\n",
      "(leí£o nascido na jaula) --> prob=[0.9731533151083765,0.026846684891623437], prediction=0.000000\n",
      "(micropoetry // a bot by @inky) --> prob=[0.9989623951798604,0.001037604820139641], prediction=0.000000\n",
      "(multilevel marketing,mmm. monitec, zewang, achieveyodreams, E.T. C.) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(prabida) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(principal speech architect at Voci, ex-maintainer of cmusphinx, practitioner of speech recognition, machine/deep learning, blogger of The Grand Janitor Blog ?) --> prob=[0.9998188938662621,0.00018110613373792378], prediction=0.000000\n",
      "(straight-up rip-off of @doesathing_nice, except it's a bot // reports to @thricedotted) --> prob=[0.9984635321257656,0.0015364678742343617], prediction=0.000000\n",
      "(you were probably saving them for breakfast. srry.) --> prob=[0.9678664002940415,0.032133599705958624], prediction=0.000000\n",
      "(‰Ï¥) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "( Northern Ireland\"\"\") --> prob=[0.9958648708760058,0.004135129123994186], prediction=0.000000\n",
      "( SC\"\"\") --> prob=[0.997622579489907,0.002377420510093122], prediction=0.000000\n",
      "(\"\"\"\") --> prob=[0.559135202067154,0.4408647979328461], prediction=0.000000\n",
      "(\"\"\"An innovative) --> prob=[0.9672865747635007,0.03271342523649925], prediction=0.000000\n",
      "(\"\"\"Attack on titan The Best. you didn't know The world !\"\"\") --> prob=[0.9953866088679677,0.004613391132032356], prediction=0.000000\n",
      "(\"\"\"Character designer for Pixar animation.\"\"\") --> prob=[0.9727691329840777,0.0272308670159222], prediction=0.000000\n",
      "(\"\"\"Katie Lin\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(\"\"\"Visit https://t.co/LLiUGW8lBD for PokŽmon location and follow @EpicSGPokemon for uber rare ones.\\n\\nFollow @SGPokeStatus for more info and status update.\"\"\") --> prob=[0.992867582075159,0.0071324179248409905], prediction=0.000000\n",
      "(#ShadesOfBlue Returns March 5th On NBC, #WorldOfDance Coming This Spring On NBC, #ByeByeBirdieLive! Next Winter On NBC, #JLoVegas: https://t.co/Vr9yBT9OHp) --> prob=[0.9964651911226539,0.0035348088773461133], prediction=0.000000\n",
      "(#following(100%) #music #classic #news #bassball #travel #movie #pop #__ #____ #__ #jesus) --> prob=[0.9860680436869685,0.013931956313031518], prediction=0.000000\n",
      "(#miracle out now #Karma new album out now @sonymusic @ultrarecords #Karma UK|European tour starting September16-Feb27 '17) --> prob=[0.9984935711209542,0.0015064288790457233], prediction=0.000000\n",
      "(*record scratch* *freeze frame* You might be wondering how this bot got here. @lanewinfield made it and it tweets ~10x/day Rand YT videos + fav TV/movie trope) --> prob=[0.9999426096661179,5.7390333882033686e-05], prediction=0.000000\n",
      "(15-year NFL vet. Analyst. And yes, you're at the right place for the #EntertainingTruth Instagram: @TakeoSpikes51) --> prob=[0.9981734298190718,0.0018265701809281794], prediction=0.000000\n",
      "(A full stack entrepreneurship experience in the UAE. We offer entrepreneurship training open to the community and run the startAD incubator) --> prob=[0.8436985029611832,0.15630149703881677], prediction=0.000000\n",
      "(A lighthearted but deep look into modeling, simulation, and optimization and how it shapes the world around us.) --> prob=[0.9990564537264933,0.000943546273506699], prediction=0.000000\n",
      "(A place for fans to connect! Tweeting from Mumbai and the world! #Bollywood #India #Parody) --> prob=[0.9950047434215081,0.004995256578492009], prediction=0.000000\n",
      "(Actor.) --> prob=[0.9828574319191267,0.017142568080873267], prediction=0.000000\n",
      "(After 11 years at TED, I'm now launching a content incubator (watch this space...). I tweet about media, technology, science, culture & ideas.) --> prob=[0.9999526777404987,4.7322259501335796e-05], prediction=0.000000\n",
      "(Artist and Social Entrepreneur. Since 2007 i have been on a mission of   USING ART TO CHANGE LIVES.) --> prob=[0.993877622339323,0.006122377660676992], prediction=0.000000\n",
      "(Automatic follow back account. Will automatically follow anyone back. To talk to me, mention me on my main.) --> prob=[0.9987789061637843,0.0012210938362157092], prediction=0.000000\n",
      "(BC Defensive Coordinator) --> prob=[0.9656419501127859,0.034358049887214255], prediction=0.000000\n",
      "(Born in 1989.) --> prob=[0.9659749342388266,0.034025065761173305], prediction=0.000000\n",
      "(Bot, What people tweet about living in new york) --> prob=[0.9963572400834697,0.0036427599165302204], prediction=0.000000\n",
      "(Bringing you all the #GoombaNews as it happens.) --> prob=[0.9848175956369375,0.015182404363062427], prediction=0.000000\n",
      "(CEO @influenceandco, @Forbes @Inc columnist, speaker, father/husband. I work with some of the best brands and most influential people to grow their influence) --> prob=[0.9995300980571185,0.0004699019428814948], prediction=0.000000\n",
      "(Chasing erudition. Twitter is my public notepad.) --> prob=[0.9861268826235173,0.013873117376482554], prediction=0.000000\n",
      "(Check out our new album Love, Lies & Therapy. Visit https://t.co/9JcTXbz5bK for more info. Also new content @ salivachannel on Youtube.) --> prob=[0.9980337561747443,0.0019662438252557057], prediction=0.000000\n",
      "(Chief Experience Officer of Microsoft Office Products Group. Inspired by my kids, my team, (and fashion!). Passionate about tech that makes life easier.) --> prob=[0.995519341888053,0.004480658111946831], prediction=0.000000\n",
      "(Christianity Today is the source for those eager to engage the world for Christ and curious about the people, events, and trends shaping the church and culture.) --> prob=[0.9973389960435756,0.0026610039564244014], prediction=0.000000\n",
      "(Computing fan.) --> prob=[0.4644549578636766,0.5355450421363235], prediction=1.000000\n",
      "(Contemporary Pop Art, Custom Paintings and Portraits by Sarasota Artist Matt Pecson ORDER via ETSY (below)) --> prob=[0.9831818097748902,0.01681819022510966], prediction=0.000000\n",
      "(Currently trying to make a short film about the art of screenwriting...follow my journey.) --> prob=[0.997389681768211,0.0026103182317890597], prediction=0.000000\n",
      "(Dad. Husband. Chairman of @WaysandMeansGOP. Deputy Whip. Loves: Baseball and Texas.) --> prob=[0.9966518607028186,0.003348139297181427], prediction=0.000000\n",
      "(Data Scientist @Microsoft with a mission to help empower all lives. #Economics #Science - aligning #data and #AI with human value @danabases #mydatalake) --> prob=[0.9936694228821238,0.0063305771178762], prediction=0.000000\n",
      "(Defining a new API is easy, all you need is a thesaurus! Special thanks to SCOTUS for refusing cert on Oracle v. Google. (by @alicemazzy)) --> prob=[0.9992792556739973,0.0007207443260026346], prediction=0.000000\n",
      "(Destigmatizing a misunderstood and unappreciated part of our vocabulary.) --> prob=[0.9720231334476386,0.027976866552361514], prediction=0.000000\n",
      "(Detroit Lions Official Twitter Page) --> prob=[0.9653612623521418,0.03463873764785821], prediction=0.000000\n",
      "(Didn't get enough #botsummit? Here's some more talks! Templates by @IAmAboutUs, @cblgh, and @beaugunderson) --> prob=[0.9976108344766947,0.002389165523305284], prediction=0.000000\n",
      "(EmpresÌÁrio e apresentador do programa 50 por 1 na TV Record. Fundador e dono  do Cafe de a Musique! http://t.co/T4UL7HDteT) --> prob=[0.9992908852305964,0.0007091147694036497], prediction=0.000000\n",
      "(Entrepreneur and connector. Founder of @Due I blog about my successes and epic failures for @Entrepreneur @TechCrunch and @Mashable #fintech) --> prob=[0.9995192188812497,0.0004807811187502076], prediction=0.000000\n",
      "(Entrepreneur, Web-desidner, developer.) --> prob=[0.9764648432709669,0.023535156729033013], prediction=0.000000\n",
      "(Entrepreneur. Design Enthusiast. Reader. Writer. Shopaholic. Experimental Cook.) --> prob=[0.9986350396171595,0.0013649603828403969], prediction=0.000000\n",
      "(Family Man.Own Cavs.Chief Quicken Loans and Fathead Dude. Love big midwest cities. Believe we all have power to think and positively change the world. Do you?) --> prob=[0.9989638636188469,0.0010361363811531446], prediction=0.000000\n",
      "(Follow me and know me better) --> prob=[0.9868552158034969,0.013144784196503001], prediction=0.000000\n",
      "(For booking info visit my websitehttp://www.nicolemurphydesigns.com /follow me on IG Nikimurphy) --> prob=[0.9967384392808666,0.0032615607191334153], prediction=0.000000\n",
      "(GO FOLLOW @CatarinaLiz BC SHE GAVE YOU THIS FREE FOLLOW) --> prob=[0.9959909208869183,0.004009079113081619], prediction=0.000000\n",
      "(Generates tweet-sized crosswords once per day. Be the first to @ reply with your solution! A bot by @gangles, words & hints from Simple English @Wikipedia.) --> prob=[0.9999634220265816,3.6577973418318226e-05], prediction=0.000000\n",
      "(Husband & father. 49th Lt. Gov. of California and former SF Mayor.) --> prob=[0.9786131633715894,0.02138683662841054], prediction=0.000000\n",
      "(I am a Mom, Wife, and bad a** Correctional Officer!) --> prob=[0.9960285732441246,0.003971426755875297], prediction=0.000000\n",
      "(I am a bot. @vectorpoem created me to post random places from the worlds of Doom every day.) --> prob=[0.999222033077226,0.0007779669227738703], prediction=0.000000\n",
      "(I don't give a damn about no damn Drake night) --> prob=[0.9968126001418576,0.0031873998581424157], prediction=0.000000\n",
      "(I have more than a thousand valuable Alots, known by their countless abilities. I created this account to help those people in need of an Alot.) --> prob=[0.9814275813552348,0.018572418644765127], prediction=0.000000\n",
      "(I slice up words for your amusement.) --> prob=[0.993960625784028,0.0060393742159720485], prediction=0.000000\n",
      "(I think I'm a good person, trying everyday.) --> prob=[0.9157669171863231,0.08423308281367697], prediction=0.000000\n",
      "(I'm a professor of history at Brooklyn College and the CUNY Graduate Center. Former Fulbright at @telavivuni; former track announcer at @ScarboroDowns.) --> prob=[0.9972085778432774,0.002791422156722597], prediction=0.000000\n",
      "(In case you missed any important events of the day, let's rewind a bit.) --> prob=[0.9991521901671169,0.0008478098328831743], prediction=0.000000\n",
      "(It's lonely out in space. Rookie @exoriders paired off, every ten-after.) --> prob=[0.992252894746906,0.007747105253093998], prediction=0.000000\n",
      "(Jay Sean. Singer/Songwriter. Sony Music.) --> prob=[0.9801344718036938,0.019865528196306253], prediction=0.000000\n",
      "(Jeopardy! fixture of yesteryear. Author of the Junior Genius Guides and a bunch of other stuff. https://t.co/6osivaktzC) --> prob=[0.9980384845828174,0.0019615154171825832], prediction=0.000000\n",
      "(John Densmore is the drummer for The Doors. He is also an author, activist and performance artist.) --> prob=[0.9987945598270468,0.0012054401729532714], prediction=0.000000\n",
      "(Just pingin' away at @poll to make sure the whole stack is in working order. I'm bored :() --> prob=[0.9991905284278263,0.00080947157217369], prediction=0.000000\n",
      "(Just trying to follow THE MASTER LEADER JESUS, it's not easy, but I know what wait for me in the end of the road and I got so thrilled for that!) --> prob=[0.999945518849288,5.448115071188931e-05], prediction=0.000000\n",
      "(Kazetaria, Periodista, Journalist.) --> prob=[0.9699617342912724,0.03003826570872766], prediction=0.000000\n",
      "(Lead Technologist for data & intelligent systems @DigiCatapult ~ designing industrial strategy for digital | former lead data scientist @PlayStation & @Guardian) --> prob=[0.9995473953936032,0.00045260460639695365], prediction=0.000000\n",
      "(Libriano, Astrologia, Sambista, CiíÈncia Polí_tica. E um pouquinho de reclamaí_í£o.) --> prob=[0.9920254213049846,0.007974578695015378], prediction=0.000000\n",
      "(Living in the Limelight the universal dream for those who wish to seem) --> prob=[0.968876020941694,0.031123979058306106], prediction=0.000000\n",
      "(MDGP Resident, TUTH, Maharajgunj) --> prob=[0.9738561981715702,0.026143801828429923], prediction=0.000000\n",
      "(MakerBot's connected 3D printing solutions address the wider needs of professionals and educators, evolving their ideas from inspiration to innovation.) --> prob=[0.9955009943609422,0.00449900563905766], prediction=0.000000\n",
      "(Malaysian first) --> prob=[0.9673623465476358,0.03263765345236428], prediction=0.000000\n",
      "(Middle age is youth without levity; and age without decay.) --> prob=[0.8290199515961589,0.170980048403841], prediction=0.000000\n",
      "(Mom, Co-Founder of ORA TV, Podcast: Back and Forth w/ Shawn & Larry King https://t.co/Af74HcYDI8 https://t.co/IvNOSD83jO.) --> prob=[0.997682808121364,0.0023171918786360044], prediction=0.000000\n",
      "(Mom, Mimi, Navair BFM, tree hugger.) --> prob=[0.9746087607334883,0.025391239266511705], prediction=0.000000\n",
      "(NYAN IS REAL, so is Narry and Larry, LOVE WINS, GAYS ARE ME LIFE, YOUTUBE 24/7) --> prob=[0.9993166333090188,0.0006833666909811108], prediction=0.000000\n",
      "(NYU Wasserman Center for Career Development.  133 E 13th Street, 2nd Floor - inside Palladium!) --> prob=[0.9967380152479118,0.0032619847520882622], prediction=0.000000\n",
      "(Neurobiologist, Artist) --> prob=[0.9649538002740922,0.03504619972590781], prediction=0.000000\n",
      "(Nine years in the NFL. Two rings.) --> prob=[0.9806282171419384,0.01937178285806162], prediction=0.000000\n",
      "(Official Twitter for all things Jonas) --> prob=[0.9581686756059559,0.04183132439404409], prediction=0.000000\n",
      "(Oscar: Best Actress, West Wing, L Word, Switched at Birth, Spring Awakening. Speaker, Author, Advocate. Contact: https://t.co/6JRljjfPr3) --> prob=[0.991596997022657,0.008403002977342974], prediction=0.000000\n",
      "(PFK Shurlok, a division of @PFK_Electronics, is a leader in the design and manufacture of OEM products and services on a global scale.) --> prob=[0.9980982305724923,0.0019017694275077956], prediction=0.000000\n",
      "(Personal Twitter Account) --> prob=[0.7426680100022272,0.25733198999777285], prediction=0.000000\n",
      "(Poker Player, 10 Time WSOP Bracelet Winner, Christian, 82 Years Old Still Going Strong) --> prob=[0.9728960741419288,0.02710392585807111], prediction=0.000000\n",
      "(Proud son and brother. Obsessive thinker and growth hacker. Auto, tech and sports enthusiast. Harboring a serious crush on guacamole since '07.) --> prob=[0.9997096319387542,0.00029036806124571455], prediction=0.000000\n",
      "(REMEMBER MY NAME.) --> prob=[0.9539345188188789,0.0460654811811211], prediction=0.000000\n",
      "(Randomly generated speculations about what emoji might appear in upcoming Unicode versions. By @aparrish.) --> prob=[0.9979521483099019,0.002047851690098267], prediction=0.000000\n",
      "(Raw, Sweaty, Dirty Rock-N-Roll! http://t.co/pcY7QOuZcn) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Read on Bustle,PlanetTransgender, CNNi,The Advocate,TheColu.mn,Gay-Essentials The NYT,HuffpoLive,Original Plumbing #girlslikeus Writer,Producer, Director,ENFP) --> prob=[0.9782299499260162,0.021770050073983773], prediction=0.000000\n",
      "(Scholar alerts on transcriptional noise, made by @biochemistries) --> prob=[0.9419410429684766,0.058058957031523535], prediction=0.000000\n",
      "(Search Engineer) --> prob=[0.9861774429889533,0.013822557011046833], prediction=0.000000\n",
      "(So in love with Jesus ? Married to the love of my life @jeffhgala, Traveler, Executive Assistant @lifestonepgh, Grad Student, TX-PA ?) --> prob=[0.999982263089085,1.7736910915082277e-05], prediction=0.000000\n",
      "(Sr. Director of Satellite Engineering and Operations for Sirius XM Radio) --> prob=[0.9952216670423093,0.004778332957690592], prediction=0.000000\n",
      "(Streaming biological articles of top relevance in the fields of cell- and molecular biology and genetics. Caution: addictive!) --> prob=[0.035379986541886774,0.9646200134581133], prediction=1.000000\n",
      "(Tenured professor, Director of Black Church Studies, minister, activist, womanist theologian, displaced New Yorker, lover of words, in search of...) --> prob=[0.9998955086252187,0.000104491374781252], prediction=0.000000\n",
      "(The 16x Champ is Here on Twitter! See me Tuesday nights on #SDLIVE on @USA_Network! #NeverGiveUp) --> prob=[0.9951136463265271,0.004886353673473032], prediction=0.000000\n",
      "(The non-profit preprint server for the life sciences) --> prob=[0.9968701815650753,0.0031298184349246067], prediction=0.000000\n",
      "(This is me - friend of people, animals, and robots. Founder and CEO of Magic Leap.) --> prob=[0.9992448599021294,0.0007551400978706673], prediction=0.000000\n",
      "(Throw away your other Twitch bots. I'm the best Twitch bot you'll ever find. For support, visit https://t.co/MjyvbaH6TN.) --> prob=[0.9986823595583968,0.0013176404416032148], prediction=0.000000\n",
      "(Tulsa Enthusiast. Accountant.  Entrepreneur. Volunteer.) --> prob=[0.9930358161953894,0.006964183804610567], prediction=0.000000\n",
      "(Tweets new releases on Netflix Instant. Created by @zak123. Check out @Redbox_bot as well. Updates between 5-7AM MST Every Morning.) --> prob=[0.9981254430936778,0.0018745569063221966], prediction=0.000000\n",
      "(We're The Fall of Troy from Mukilteo, WA. Our new album OK is available at our website for whatever you want to pay.) --> prob=[0.9996881137477139,0.00031188625228609397], prediction=0.000000\n",
      "(Wearer of many hats, at Galois, Inc.) --> prob=[0.9521138385681699,0.04788616143183003], prediction=0.000000\n",
      "(Your diac No) --> prob=[0.9674735311982636,0.032526468801736264], prediction=0.000000\n",
      "(a bot that tweets random crown the empire lyrics every 30 minutes. [[ non bot tweets in brackets ]]) --> prob=[0.9995069156555608,0.0004930843444391561], prediction=0.000000\n",
      "(after 98173648492 accounts. new account again _ôÖ_ôÖ Hi! _ô_„) --> prob=[0.9816111962018284,0.01838880379817171], prediction=0.000000\n",
      "(attempting radical coziness at all times) --> prob=[0.988205566817949,0.011794433182050913], prediction=0.000000\n",
      "(bot by @ckolderup ‰Û¢ #botALLY ‰Û¢ thanks to #CBDQ ‰Û¢ not real propositions, please consult a voter guide) --> prob=[0.9998283746686562,0.00017162533134377605], prediction=0.000000\n",
      "(first class charmer.) --> prob=[0.9673623465476358,0.03263765345236428], prediction=0.000000\n",
      "(free follow from @itskaisehun go follow !) --> prob=[0.9913559049187421,0.008644095081257835], prediction=0.000000\n",
      "(give me food...insta ---@JERM_beats) --> prob=[0.9769692661248006,0.02303073387519931], prediction=0.000000\n",
      "(hi everyone please add me on games console look play online play friends and others gamers players I have PlayStation 3 and PlayStation 4 and 360,wiiUMariomaker) --> prob=[0.9941139447689548,0.005886055231045275], prediction=0.000000\n",
      "(https://t.co/k5nleOQ50q / #MercerLaw) --> prob=[0.9653480456798442,0.034651954320155776], prediction=0.000000\n",
      "(it turns out there have been a lot of songs written about @thricedotted's catte, haku!!! like who wouldn't write a song about this perfect bb tho :3) --> prob=[0.9996534318630135,0.00034656813698650933], prediction=0.000000\n",
      "(just trying not to lose my shit) --> prob=[0.9845559209717872,0.01544407902821279], prediction=0.000000\n",
      "(quer ir no Planeta Terra e í± tem ingressos? o onibus mudou, mas suas chances continuam as mesmas.Siga o novo busí£o: http://t.co/0kD9W9ocdA) --> prob=[0.9962407065693231,0.0037592934306768], prediction=0.000000\n",
      "(senior editor @Racked // writing a book of essays about crafting for @FlatironBooks // @buzzfeed alum // alanna.okun@racked.com) --> prob=[0.9990727653242693,0.0009272346757308558], prediction=0.000000\n",
      "( California\"\"\") --> prob=[0.9665115803217659,0.03348841967823409], prediction=0.000000\n",
      "(\"\"\"\") --> prob=[0.559135202067154,0.4408647979328461], prediction=0.000000\n",
      "(\"\"\"Ai__\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(\"\"\"AlolaFen\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(#OAKLANDFIGHTCLUB IIIXX OPUS #LetterFromYourBrother #DontGo #SayItIsntSo #StillWater #LoveIsLove #DubNation #RaiderNation #A's #StreetsIsReady #Kurious #DaPlug) --> prob=[0.9679963722843622,0.03200362771563782], prediction=0.000000\n",
      "(#RNomics, #RNA biology, RNA #bioinformatics, #RNA_World & #evolution, technologies & resources, daily papers: https://t.co/UaH05PfPIt & https://t.co/cuczvAA7dr) --> prob=[0.9320792006325683,0.06792079936743169], prediction=0.000000\n",
      "(''The 'Hello World' of jokey, generative Twitter bots.'' - @joshmillard Creates bad ideas for startups. Made by @NoraReed with help from just_post.) --> prob=[0.9998680740221506,0.00013192597784930123], prediction=0.000000\n",
      "(1 Bristolia.) --> prob=[0.989237908411138,0.010762091588861964], prediction=0.000000\n",
      "(23. Jays, trays, and fadeaways. T-Wolves and Packers.) --> prob=[0.966044117975261,0.03395588202473896], prediction=0.000000\n",
      "(@gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(@realajavolkman, @danielepand, @richk) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(A SO‰Ð_URCE FOR GOO‹ÎÇD ADVICE AND NOT A B‰ÐÓOT OR DEM‹ÄON) --> prob=[0.9858009330919499,0.014199066908049977], prediction=0.000000\n",
      "(A bot that generates rules for impossible card games. By @atduskgreg.) --> prob=[0.9969926458518091,0.0030073541481907677], prediction=0.000000\n",
      "(A compendium of newly discovered species of clitoris // by @startuple #botALLY) --> prob=[0.6467250482833108,0.35327495171668927], prediction=0.000000\n",
      "(Art Automata [bot]. See url below for how to help to keep me running.) --> prob=[0.9945195024333641,0.005480497566636044], prediction=0.000000\n",
      "(Author, Speaker & Force for Good ‰Ñ Book One: Beyond #ADHD ‰Ñ From Tragedy To Triumph! ‰Ñ Agent: @DanaNewman) --> prob=[0.9992618341082583,0.0007381658917417736], prediction=0.000000\n",
      "(AutoMate is a Horizon 2020 EU funded project focused on novel driver-automation cooperation concepts.) --> prob=[0.9952511112419907,0.004748888758009243], prediction=0.000000\n",
      "(Best Strategy Guides for PÌ«neis Brilhantes series) --> prob=[0.9844837497423159,0.015516250257684234], prediction=0.000000\n",
      "(Born & bred in Singapore, currently residing in Taiwan. We are all placed on earth to leave imprints on each others' lives.) --> prob=[0.9966477162832305,0.0033522837167694547], prediction=0.000000\n",
      "(Cells move about, have brief encounters, spawn more cells & die. A new life story every 8 hours. Lab technician: @zoot_allures) --> prob=[0.7839601690778034,0.21603983092219653], prediction=0.000000\n",
      "(Everything about chromatin, enhancers and genome architecture. Manually picked by @IvKrivega) --> prob=[0.9201746576505502,0.07982534234944991], prediction=0.000000\n",
      "(Excerpts from Shakespeare's works randomly selected, then sprinkled with fucks. Longer excerpts here: http://t.co/CNwtEVVDfs A bot by @deathmtn.) --> prob=[0.9976690288521606,0.002330971147839413], prediction=0.000000\n",
      "(Exploring Hubble's largest photo (69536x22230px), a little bit at a time. A bot by @joemfox. More info: http://t.co/auTvn3Cjl9) --> prob=[0.999458211272908,0.0005417887270919996], prediction=0.000000\n",
      "(Faith is taking the first step even when you don't see the whole staircase.) --> prob=[0.9996817884633906,0.00031821153660945614], prediction=0.000000\n",
      "(Finance Minister, Minister of Corporate Affairs and Minister of Information and Broadcasting, Government of India) --> prob=[0.9947068024950936,0.005293197504906471], prediction=0.000000\n",
      "(Follow us to know when it's time for a drink. @bugloaf made me.) --> prob=[0.9950121190380559,0.004987880961944162], prediction=0.000000\n",
      "(Former Governor of Alaska and GOP Vice Presidential Nominee. Tweets by Sarah Palin signed - SP) --> prob=[0.996812385318124,0.0031876146818759824], prediction=0.000000\n",
      "(Founder and Chairman of Rasmussen Global) --> prob=[0.9921316840138527,0.007868315986147345], prediction=0.000000\n",
      "(Free Follow for @jalfiebutler ... follow back please or I'll unfollow _Ùªâ) --> prob=[0.9994846402235852,0.0005153597764147667], prediction=0.000000\n",
      "(Get thousands followers with this website, fast, cheap and easy. at https://t.co/5IUBOuvsyT) --> prob=[0.9925915047288602,0.0074084952711399865], prediction=0.000000\n",
      "(Graduate student at NYU Tandon School of Engineering. Fan-fic reader and engineer by day soccer defender at night. Manchester United FC is life.) --> prob=[0.9999476988220292,5.230117797081923e-05], prediction=0.000000\n",
      "(Hey imToni and im acertified Zumba Intructor.) --> prob=[0.9961071883102306,0.003892811689769377], prediction=0.000000\n",
      "(I do not bring forgiveness with me; nor forgetfulness. The only ones who can forgive are dead; the living have no right to forget.) --> prob=[0.9810736253100948,0.01892637468990514], prediction=0.000000\n",
      "(I rehabilitate dogs. I train people. I hope that I can be an inspiration to everyone out there who is trying to live their dream.) --> prob=[0.9998945708619332,0.00010542913806680165], prediction=0.000000\n",
      "(I'm an urban dweller who has the beach at heart. When I'm not running promotions or events, you can catch me teaching, at concerts, or, out in the sun.) --> prob=[0.9999854700108953,1.4529989104650405e-05], prediction=0.000000\n",
      "(I'm that actor in some of the movies you liked and some you didn't. Sometimes I'm in pretty good shape, other times I'm not. Hey, you gotta live, you know?) --> prob=[0.9999714318195974,2.856818040273459e-05], prediction=0.000000\n",
      "(Instruments of mass construction. Made by @sculpin with Cheap Bots Done Quick. Updates twice a day. Occasionally brought to life as @Anomalophones.) --> prob=[0.9998679102859295,0.00013208971407065382], prediction=0.000000\n",
      "(Investigative reporter, Washington Post) --> prob=[0.9908048259789434,0.009195174021056567], prediction=0.000000\n",
      "(Jenny lives, works, and writes in Brooklyn with her partner, twins, and pit bull.) --> prob=[0.9682489623959644,0.03175103760403567], prediction=0.000000\n",
      "(MD @SprintPirates, former Head of Acceleration @Sbootcamp,co-founder and former CEO @Seed_Engine, co-founder @seed_academySA #amsterdam #damjuice #startup) --> prob=[0.9978611467205385,0.002138853279461435], prediction=0.000000\n",
      "(Minister of External affairs) --> prob=[0.9515819614532098,0.04841803854679025], prediction=0.000000\n",
      "(Mom of four amazing kids, professional speaker and decision strategist. World Series of Poker bracelet winner and author of four books on poker.) --> prob=[0.9999025198984126,9.748010158743097e-05], prediction=0.000000\n",
      "(More than 75% of Bletchley Park's code-cracking veterans are women. Full list: http://t.co/2tNLDxBxyk. Bot by @marythought.) --> prob=[0.9975289044575106,0.002471095542489382], prediction=0.000000\n",
      "(Music & meltdowns) --> prob=[0.9663830129685477,0.03361698703145235], prediction=0.000000\n",
      "(NHL player with St Louis Blues. GenEthix partner.) --> prob=[0.9862211179741582,0.013778882025841818], prediction=0.000000\n",
      "(New Publications in Population Landscape and Ecological Genomics from #arXiv, #bioRxiv and #Pubmed. Curated by Vikram Chhatre (@popgenomics)) --> prob=[0.007547455994501334,0.9924525440054988], prediction=1.000000\n",
      "(News stories that matter.) --> prob=[0.978062245541521,0.021937754458479043], prediction=0.000000\n",
      "(No child should grow up behind prison walls.) --> prob=[0.9889757041260951,0.011024295873904771], prediction=0.000000\n",
      "(Not part of a famous Canadian comedy troupe. Myers/Briggs: DGAF.) --> prob=[0.9890078481278874,0.01099215187211254], prediction=0.000000\n",
      "(OFFICIAL account of PoonamPandey. Model & Actress from Mumbai, Instagram : ipoonampandey  Puuhrulz@gmail.com  Snapchat: ipoonampandey) --> prob=[0.995720226911064,0.004279773088935896], prediction=0.000000\n",
      "(OT4 and Zayn__) --> prob=[0.9600753213914668,0.03992467860853313], prediction=0.000000\n",
      "(Official Twitter Site for Actor Gil Birmingham.) --> prob=[0.9969971232105613,0.003002876789438607], prediction=0.000000\n",
      "(Official account of Governor Charlie Baker of Massachusetts.) --> prob=[0.9674976721500054,0.03250232784999457], prediction=0.000000\n",
      "(Old age has deformities enough of its own. It should never add to them the deformity of vice.) --> prob=[0.7255384493391386,0.2744615506608613], prediction=0.000000\n",
      "(Old tweets are kind of weird. This bot retweets one of the first 7500 tweets (first 90 days of Twitter) four times a day. // by @tinysubversions) --> prob=[0.9999614505920917,3.8549407908275306e-05], prediction=0.000000\n",
      "(Owner Of GLAM Beverly Hills,Model, Actress, Business Woman, Playmate, Reality Star, Brand, CEO, #Xtina Instagram @KristinaShannon1 SnapChat glamxtina) --> prob=[0.9993797523602824,0.0006202476397176641], prediction=0.000000\n",
      "(Pastor of Empowerment Temple in Baltimore, MD) --> prob=[0.9605530973666525,0.03944690263334748], prediction=0.000000\n",
      "(Pastor, IBABI, Igreja Batista Bí_blica, Jacareí, SP) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Pictures taken by @NOAA buoys in the middle of the ocean. I'm a bot by @fitnr) --> prob=[0.9990155789382323,0.0009844210617676022], prediction=0.000000\n",
      "(Pretty girl from Denmark. Want to meet somebody for virt. Find me here https://t.co/NDxXt2gbnZ. My nick Musi) --> prob=[0.9974820020084679,0.0025179979915321824], prediction=0.000000\n",
      "(Purveyor of custom scientific eponyms since 2014. Eponyms coined for random followers every few hours. Bot by @arbesman.) --> prob=[0.9933969598447809,0.006603040155219017], prediction=0.000000\n",
      "(Queen's NRI Hospital, a 380 bed multi-specialty acute-cum-critical care referral hospital, is one of the most well-equipped and premier hospitals in Vizag.) --> prob=[0.995197001868436,0.004802998131564111], prediction=0.000000\n",
      "(Quoting those too often overlooked. Tweet a hashtag @the_underquoted to see if any quotes match that word. Tweets one unsolicited quote a day.) --> prob=[0.9942740903530431,0.00572590964695671], prediction=0.000000\n",
      "(Reminders to take your medications from a robot that swallowed a thesaurus. By @NoraReed.) --> prob=[0.9953635306913022,0.004636469308697896], prediction=0.000000\n",
      "(Replacement for @FalseFlagBot R.I.P. #nWo #illuminati #falseflag) --> prob=[0.9538402474419598,0.046159752558040244], prediction=0.000000\n",
      "(Retweet bot for my #indiedev #gameDev bros and gals! Follow for increased retweet chance! Also follow my main account @quantomworks ! Happy coding :)) --> prob=[0.9990313054235868,0.000968694576413189], prediction=0.000000\n",
      "(Revelation can be more perilous than Revolution - Nabokov. That, and #FinTech #FemTech. Lots of both, actually.) --> prob=[0.995982760824132,0.0040172391758679015], prediction=0.000000\n",
      "(SOCIAL ON GLOSSATORY: the branch of the considered addered poker by looses - a bot by @bombinans) --> prob=[0.9991255100570834,0.0008744899429166226], prediction=0.000000\n",
      "(THIS IS RAMBO) --> prob=[0.9672581462431967,0.03274185375680322], prediction=0.000000\n",
      "(Taylor Gang) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(The White Album Deluxe Edition out now - download on iTunes https://t.co/wBYl3ZbxJ2 listen on Spotify https://t.co/TfENgKaTfm Tour dates https://t.co/GDUMuOiLaf) --> prob=[0.99962847755427,0.00037152244573008516], prediction=0.000000\n",
      "(The beast howls in my veins) --> prob=[0.9676617035594415,0.032338296440558516], prediction=0.000000\n",
      "(Train - Fight - Win! I'm 57-0 kickboxer and 5 time world champion working hard every day to become an elite MMA champion. Currently 8-1-1 in the UFC) --> prob=[0.999851740171655,0.00014825982834503986], prediction=0.000000\n",
      "(Tweets BuzzFeed titles in Hulk-talk / Not affiliated with BuzzFeed / Bot by @undoingsarah) --> prob=[0.9966480460461816,0.0033519539538184005], prediction=0.000000\n",
      "(Twitter CMO. Favorite title: Mama. Never, ever a dull moment. #WWED) --> prob=[0.9907611674379854,0.009238832562014507], prediction=0.000000\n",
      "(Updated Daily for tips to lose weight from me and from others.) --> prob=[0.5861041819664882,0.41389581803351183], prediction=0.000000\n",
      "(Visual storyteller | Photographer based in Italy.) --> prob=[0.9985438961351136,0.001456103864886441], prediction=0.000000\n",
      "(We added you on Myspace. Our new album SOME THINGS NEVER LEAVE YOU available now. @natehenrysays @dankoch) --> prob=[0.9989523518666227,0.001047648133377425], prediction=0.000000\n",
      "(We are the music makers, and we are the dreamers of dreams...) --> prob=[0.9986149457698708,0.0013850542301292491], prediction=0.000000\n",
      "(We feed 1.4M kids in India daily; promoting education and eradicating hunger. Visit us at http://t.co/KeAZERhd0J) --> prob=[0.9975520905147534,0.002447909485246597], prediction=0.000000\n",
      "(Wife åá Mother åá Decorator åá Cook åá PartyThrower åá Singer åá Producer åá Writer åá Musician åá Whew!) --> prob=[0.997370407438101,0.0026295925618990412], prediction=0.000000\n",
      "(With algorithms subtle and discrete / I seek iambic writings to retweet.) --> prob=[0.9995628048786098,0.00043719512139017507], prediction=0.000000\n",
      "(You were looking for a bot, and then you found a bot. I'm Miserable Now, by @mambocab. ~5 tweets/day. Code/acknowledgments on GitHub.) --> prob=[0.9995646187110765,0.00043538128892356854], prediction=0.000000\n",
      "([‰ª»]) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(bot by @ckolderup ‰Û¢ #botALLY) --> prob=[0.9972779753524805,0.002722024647519577], prediction=0.000000\n",
      "(bot by @ckolderup ‰Û¢ #botALLY) --> prob=[0.9972779753524805,0.002722024647519577], prediction=0.000000\n",
      "(butts. butt botts. butt things. https://t.co/9K7GC6ImGN #rumpology - @speckninja (bot favs tweets containing 'butt')) --> prob=[0.9828023838743485,0.017197616125651564], prediction=0.000000\n",
      "(colors.  all of 'em. | developed by @vogon; feel free to send him feedback/feature requests) --> prob=[0.9967083068428154,0.003291693157184505], prediction=0.000000\n",
      "(follow @drakeftagb) --> prob=[0.9975385003388678,0.002461499661132165], prediction=0.000000\n",
      "(go subscribe to my channel http://t.co/tMLNHqUGp9) --> prob=[0.9931788975714837,0.0068211024285162085], prediction=0.000000\n",
      "(how i'd wish that were so.) --> prob=[0.9886261409082728,0.0113738590917272], prediction=0.000000\n",
      "(http://t.co/YfHoThSDVQ...) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(portmanteaus, portmanteaus everywhere // by @thricedotted) --> prob=[0.97952842508274,0.020471574917259948], prediction=0.000000\n",
      "(starting leade.rs) --> prob=[0.9731268672750144,0.026873132724985573], prediction=0.000000\n",
      "(weeee willll weee willll rock you!) --> prob=[0.9861531315675336,0.013846868432466556], prediction=0.000000\n",
      "(you're here with me now) --> prob=[0.9929465438784209,0.007053456121579045], prediction=0.000000\n",
      "(µµÜ‰Í_ÜÜ_Ü») --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "( FL\"\"\") --> prob=[0.9665115803217659,0.03348841967823409], prediction=0.000000\n",
      "( South Yorkshire) --> prob=[0.9783150714050958,0.021684928594904236], prediction=0.000000\n",
      "(\"\"\"\") --> prob=[0.559135202067154,0.4408647979328461], prediction=0.000000\n",
      "(\"\"\"Bulu Bulu Kehidupan\"\"\") --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(\"\"\"Saint Seiya 4Ever\"\"\") --> prob=[0.989134258141103,0.01086574185889701], prediction=0.000000\n",
      "(\"\"\"The official Manchester City Twitter account | Supporter Services __ @ManCityHelp | Snapchat __ mancityofficial\"\"\") --> prob=[0.9996266697327117,0.00037333026728810756], prediction=0.000000\n",
      "(#VampireLife bookings for #JimJones bookjimjones@gmail.com  info@nextofkinent.com) --> prob=[0.9670415803730897,0.032958419626910304], prediction=0.000000\n",
      "('Wow' Out Now - https://t.co/D8mflkQEe0) --> prob=[0.9842455477594151,0.01575445224058488], prediction=0.000000\n",
      "(*IN BETA* Low-res, slightly bizarre Open Access images from the Met (via @MuseumBot) crossed with palettes from @colourlovers. Powered by @uncontext. By @_ARP.) --> prob=[0.9982471431522401,0.0017528568477598325], prediction=0.000000\n",
      "(1) --> prob=[0.989237908411138,0.010762091588861964], prediction=0.000000\n",
      "(@styletiana is hot.) --> prob=[0.9572846212972469,0.042715378702753104], prediction=0.000000\n",
      "(A bot by @NoraReed Patreon: https://t.co/f7OKH9MO9D Tip Jar: https://t.co/KOMoL6IrsM‰Û_ FAQ: https://t.co/Z49vqlFP4x) --> prob=[0.998803398615292,0.0011966013847079227], prediction=0.000000\n",
      "(A bot that creates hilarious joax via Google's autocomplete. By @deathmtn.) --> prob=[0.9644041898458953,0.03559581015410465], prediction=0.000000\n",
      "(A bot that generates random malfunctioning equipment, created by @notinventedhere using http://t.co/XpDujaprri) --> prob=[0.9970389856365034,0.0029610143634966586], prediction=0.000000\n",
      "(A bot tweeting links to new archaeological journal articles. Limited to those journals that provide RSS!) --> prob=[0.8880365492040543,0.11196345079594577], prediction=0.000000\n",
      "(Activist. Actress. Artist. Instagram: @lindsaylohan https://t.co/FjAZzhuK6y Management: scott@honestmg.com) --> prob=[0.9804100264513965,0.01958997354860344], prediction=0.000000\n",
      "(Anchor of Erin Burnett OutFront.) --> prob=[0.9699958866890156,0.0300041133109844], prediction=0.000000\n",
      "(Anime, Game, Programming, Tech, and other nonsense äóñ in Thai, English) --> prob=[0.9658197471741735,0.03418025282582652], prediction=0.000000\n",
      "(Boutique Bollywood Actor) --> prob=[0.9988763988604027,0.001123601139597223], prediction=0.000000\n",
      "(Carbon-based multicellular lifeform.) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Cat lady, singer, actor, love improv & living in Tokyo) --> prob=[0.9898163549050298,0.01018364509497006], prediction=0.000000\n",
      "(Creating a new blend of #classical, #jazz, #rock, #pop and #worldmusic using #cello as a common denominator.  Striving to make #globalimpact through #music.) --> prob=[0.9829498900888717,0.01705010991112826], prediction=0.000000\n",
      "(Dashboard Confessional Tix available NOW for our up close and personal tour in Jan and Feb of 2017: https://t.co/Bj0G7NIhy1) --> prob=[0.98023578435717,0.019764215642830055], prediction=0.000000\n",
      "(Department of History, College Students) --> prob=[0.93314496961983,0.06685503038017013], prediction=0.000000\n",
      "(Design Thinker, Dev Ops Practitioner, Lean Coach.) --> prob=[0.9959175996706936,0.004082400329306362], prediction=0.000000\n",
      "(Established in 1995, NYU's Remarque Institute supports the multi-disciplinary and comparative study of Europe and its near neighbors.) --> prob=[0.9993867358545117,0.0006132641454883041], prediction=0.000000\n",
      "(Every combination of letters that is not an English word, including some common slang and jargon. Task will complete long after we're dead. An @_ARP bot.) --> prob=[0.9986519745103372,0.001348025489662828], prediction=0.000000\n",
      "(Extremely powerful being, do not insult me. THIS IS A COMEDY ACCOUNT FOR COMEDY) --> prob=[0.9083749702040657,0.09162502979593432], prediction=0.000000\n",
      "(FITNESS) --> prob=[0.7693532076938031,0.23064679230619695], prediction=0.000000\n",
      "(Fake James Joyce novel titles. A bot by @sillygwailo. #botALLY) --> prob=[0.9975119432776605,0.002488056722339676], prediction=0.000000\n",
      "(Family over everything) --> prob=[0.9955605878626301,0.004439412137369812], prediction=0.000000\n",
      "(Fast and steady wins the race.) --> prob=[0.9653956250622198,0.03460437493778022], prediction=0.000000\n",
      "(Film buff,Actor, Director, Dancer, Writer, Producer) --> prob=[0.994130295139066,0.00586970486093385], prediction=0.000000\n",
      "(Friend of the program.) --> prob=[0.9840814288117684,0.015918571188231576], prediction=0.000000\n",
      "(From Russia, live in Amsterdam. QA engineer, test automation.) --> prob=[0.9917196442266996,0.008280355773300347], prediction=0.000000\n",
      "(Generating äóìself-portraitsäó once a day äó¢ A bot by @ashur äó¢ #botALLY) --> prob=[0.9989436388160728,0.001056361183927015], prediction=0.000000\n",
      "(Give me a museum and I'll fill it.) --> prob=[0.9854494836256708,0.014550516374329126], prediction=0.000000\n",
      "(Host of The Roe Conn Show afternoons on Chicago's WGN Radio and contributor to ABC7's Windy City Live.) --> prob=[0.9981109044611896,0.0018890955388104916], prediction=0.000000\n",
      "(I retweet questions followed by answers. Brought to you by @rfreebern.) --> prob=[0.9995780665555128,0.0004219334444871246], prediction=0.000000\n",
      "(I tweet a new horizon view every six hours.  Created by @acgodliman using cheapbotsdonequick. WIP) --> prob=[0.9986777944269176,0.0013222055730823137], prediction=0.000000\n",
      "(I'm just your average procedural avatar generating twitter bot. @bzgeb is my creator) --> prob=[0.9989379613724504,0.0010620386275496728], prediction=0.000000\n",
      "(Just some space stories. A http://t.co/8dBPX7FlIa bot (with occasional analogue stories) by @notinventedhere and @thos_thom.) --> prob=[0.9991764354707751,0.000823564529224945], prediction=0.000000\n",
      "(Late adopter.) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Legitimate reviews from 100% people, every two minutes.) --> prob=[0.9986139082625786,0.0013860917374214053], prediction=0.000000\n",
      "(Let's keep this thing going, gang! #AddaWordRuinaMovie) --> prob=[0.997629950340895,0.0023700496591051723], prediction=0.000000\n",
      "(Looking to stick it to the man yeah I hate the man) --> prob=[0.9959144909146027,0.00408550908539735], prediction=0.000000\n",
      "(Magic cards generated by a Recurrent Neural Network, posted once a day. Not Mark Rosewater.) --> prob=[0.9993723731979384,0.0006276268020615878], prediction=0.000000\n",
      "(Marketing guy, social gadfly, and general man about town) --> prob=[0.9879865476593325,0.012013452340667618], prediction=0.000000\n",
      "(On my standup comedy tour now! Details at https://t.co/2zXkcRPGgX) --> prob=[0.9965921573669834,0.0034078426330166637], prediction=0.000000\n",
      "(Pre-order The Blood Album on iTunes. https://t.co/pukqh1O7id) --> prob=[0.9789430244451034,0.021056975554896752], prediction=0.000000\n",
      "(Principal Engineer at @voxmediainc / @voxproduct. Tweets my own. Jokes shamelessly ripped from Reddit. Prev: @disqus, @threespot. ä_ StarCraft) --> prob=[0.9992474201984999,0.000752579801500112], prediction=0.000000\n",
      "(Producer/Songwriter/Lead Singer of Sixx:A.M.) --> prob=[0.9672402466706355,0.032759753329364545], prediction=0.000000\n",
      "(Secretly triggered subtweetbombing encouragement bot inspired by https://t.co/EMTnCTpOxx) --> prob=[0.9928182015150774,0.0071817984849226295], prediction=0.000000\n",
      "(Send a direct message mentioning people you really like :)                  (I'm a bot, and I do only use the @ of who you mention) (I'm a bit busy, be patient)) --> prob=[0.9999994062192255,5.937807744763001e-07], prediction=0.000000\n",
      "(Serbia is a beautiful European country, with rich history, culture, welcoming and loving people and great night life and strong art and cafe culture.) --> prob=[0.9971475933522669,0.0028524066477331137], prediction=0.000000\n",
      "(Snap: @maalenacarvalho) --> prob=[0.9679222393809251,0.032077760619074844], prediction=0.000000\n",
      "(Social Activist | Nationalist | Swayamsevak | BJP Delhi | Namo Fan | Followed By the Honourable  PM @narendramodi ji.) --> prob=[0.9962824303121753,0.0037175696878246666], prediction=0.000000\n",
      "(Stage Manager, Writer, Leader...and more.) --> prob=[0.9757853128274371,0.02421468717256286], prediction=0.000000\n",
      "(Sup) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(Television has brought back murder into the home - where it belongs.) --> prob=[0.9988312486162195,0.0011687513837803796], prediction=0.000000\n",
      "(Tennis player.) --> prob=[0.9933777575003222,0.006622242499677761], prediction=0.000000\n",
      "(Topics, news and more about nature.) --> prob=[0.9754201272403094,0.02457987275969069], prediction=0.000000\n",
      "(Tweeting all the languages. All of them. Process should finish sometime in October 2015. Created by @OnnaAdele.) --> prob=[0.9920887365859605,0.007911263414039476], prediction=0.000000\n",
      "(Tweeting every letter in the english language.) --> prob=[0.9969546951166686,0.003045304883331493], prediction=0.000000\n",
      "(Tweets from the Mayor of St. Louis' personal website. The Mayor's own tweets are signed #fgs, his initials.) --> prob=[0.9846468284474913,0.015353171552508621], prediction=0.000000\n",
      "(Tweets ~10 times a day between 8am-10pm PST. Will probably get more vaporwave-y as time goes by. Complaints: @beaugunderson) --> prob=[0.9994523076645588,0.0005476923354412391], prediction=0.000000\n",
      "(Twitterbot of cichlid PubMed papers (inspired by @fly_papers). Image Astatotilapia calliptera, K. Woodhouse. Curated by @domino_joyce.) --> prob=[0.06806078136478522,0.9319392186352147], prediction=1.000000\n",
      "(Under Construction) --> prob=[0.9866545951316917,0.01334540486830825], prediction=0.000000\n",
      "(Violet 100 event link: https://t.co/hf0W3M7i2S) --> prob=[0.9752552738158689,0.0247447261841312], prediction=0.000000\n",
      "(Welcome to http://t.co/OgGcZs9E0w. I hope to immerse you into a world all about  Oil Painting. It can become a serious passion. I Love painting!) --> prob=[0.9996741375428425,0.00032586245715753406], prediction=0.000000\n",
      "(Well-fed artist.) --> prob=[0.9858870187002571,0.014112981299743019], prediction=0.000000\n",
      "(What will John Oliver DESTROY next? A @ThisIsFusion bot. http://t.co/TITeSH2I5J) --> prob=[0.9933153847070683,0.006684615292931685], prediction=0.000000\n",
      "(You dont have to follow this account, Just follow this one @LethargicJOE to get your free follow ;) Thanks!) --> prob=[0.9995227879415923,0.0004772120584076871], prediction=0.000000\n",
      "(director.) --> prob=[0.9683300871946651,0.03166991280533496], prediction=0.000000\n",
      "(free follow from @octloveslukey, go follow her for more) --> prob=[0.9800705112039012,0.019929488796098748], prediction=0.000000\n",
      "(fuck it, put a chip in it. say hello: internetofshit@gmail.com) --> prob=[0.9908775939046492,0.009122406095350854], prediction=0.000000\n",
      "(snail half dedicated to @inky // complaints to @beaugunderson) --> prob=[0.9948502043253167,0.005149795674683285], prediction=0.000000\n",
      "(this is the only official ashlee simpson ross twitter. click your heels three times and think of me...chick-a-boom) --> prob=[0.9984378115598421,0.0015621884401579534], prediction=0.000000\n",
      "(\"\"\"\") --> prob=[0.559135202067154,0.4408647979328461], prediction=0.000000\n",
      "(@B_Real | @OGSenDog | @ericbobo | @DJ_Muggs | @juliog1580kday) --> prob=[0.972476582635222,0.027523417364778043], prediction=0.000000\n",
      "(Advice is what we ask for when we already know the answer but wish we didn't.) --> prob=[0.9985160126148076,0.001483987385192429], prediction=0.000000\n",
      "(Agricultural Engineer, likes to joke and trying to live a certain balance between his laptop at the office and his shovel in the field.) --> prob=[0.9993783186286073,0.0006216813713925854], prediction=0.000000\n",
      "(BEEP BOOP WHITE PEOPLE) --> prob=[0.9972726275355366,0.0027273724644634027], prediction=0.000000\n",
      "(CNN's host of @ReliableSources and senior media correspondent. Formerly @nytimes, @tvnewser and Top of the Morning. Email: bstelter@gmail.com) --> prob=[0.9914933044272906,0.00850669557270941], prediction=0.000000\n",
      "(Daily RSS Feed for Protein Hot Spot Prediction papers. Maintained by @selinkaragulle) --> prob=[0.11742652897548853,0.8825734710245114], prediction=1.000000\n",
      "(Every word in the English language, in Comic Sans MS. My friends think I'm fun! By @avestal.) --> prob=[0.9955858950153168,0.004414104984683245], prediction=0.000000\n",
      "(Get the latest BLONDIE news at http://t.co/LIHTvKT3h7!) --> prob=[0.9780480845369929,0.021951915463007125], prediction=0.000000\n",
      "(I DONT NEE A FUCKIN SLOGGIN FUC A TEAM I JUST FOLLOW ACK UNFOLLOW ME AND I'LL KICK YOUR ASS) --> prob=[0.999111074821368,0.0008889251786321055], prediction=0.000000\n",
      "(I tweet pentatonic ditties.) --> prob=[0.9755853936203253,0.024414606379674665], prediction=0.000000\n",
      "(I'm a Bot; I randomly retweet a tweet from the public timeline, and... that's just it.) --> prob=[0.9988107357348194,0.0011892642651806656], prediction=0.000000\n",
      "(This should be the quickest route, but it depends on the traffic) --> prob=[0.9812358489676515,0.018764151032348506], prediction=0.000000\n",
      "(UXer) --> prob=[0.9531082523438213,0.0468917476561786], prediction=0.000000\n",
      "(another one bites the dust || dancer) --> prob=[0.9897029165329236,0.01029708346707628], prediction=0.000000\n"
     ]
    }
   ],
   "source": [
    "# Make predictions on test documents and print columns of interest.\n",
    "prediction = model.transform(testData)\n",
    "selected = prediction.select(\"description\", \"probability\", \"prediction\")\n",
    "for row in selected.collect():\n",
    "    description, prob, prediction = row\n",
    "    print(\"(%s) --> prob=%s, prediction=%f\" % (description, str(prob), prediction))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the text output search for\n",
    "`prediction=1`\n",
    "\n",
    "And write in the chat which description got classified as bot!\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the text output search for\n",
    "`prediction=1`\n",
    "\n",
    "And write in the chat which description got classified as bot!\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exercise 3: Put everything together"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### CrossValidator, BinaryClassificationEvaluator and ParamGridBuilder functionality\n",
    "\n",
    "✅ **Task :** \n",
    "\n",
    "\n",
    "CrossValidator provide us the ability to run multiple training set and testing set within one function call - \n",
    "`fit`.\n",
    "\n",
    "It runs the evaluation phase and chooses the best parameters.\n",
    "\n",
    "Read about `CrossValidator` in the [docs](https://spark.apache.org/docs/latest/ml-tuning.html) and integrate it into your pipeline.\n",
    "\n",
    "In the docs, search for `CrossValidator` `python` example.\n",
    "\n",
    "Copy the example to the notebook and adjust it to your needs.\n",
    "\n",
    "From the docs:\n",
    ">`CrossValidator` - K-fold cross validation performs model selection by splitting the dataset into a set of non-overlapping randomly partitioned folds which are used as separate training and test datasets e.g., with k=3 folds, K-fold cross validation will generate 3 (training, test) dataset pairs, each of which uses 2/3 of the data for training and 1/3 for testing. Each fold is used as the test set exactly once.\n",
    "\n",
    "<details><summary>Can't find the example, click here! </summary>\n",
    "<p>\n",
    "\n",
    "```python\n",
    "from pyspark.ml import Pipeline\n",
    "from pyspark.ml.classification import LogisticRegression\n",
    "from pyspark.ml.evaluation import BinaryClassificationEvaluator\n",
    "from pyspark.ml.feature import HashingTF, Tokenizer\n",
    "from pyspark.ml.tuning import CrossValidator, ParamGridBuilder\n",
    "\n",
    "# Prepare training documents, which are labeled.\n",
    "training = spark.createDataFrame([\n",
    "    (0, \"a b c d e spark\", 1.0),\n",
    "    (1, \"b d\", 0.0),\n",
    "    (2, \"spark f g h\", 1.0),\n",
    "    (3, \"hadoop mapreduce\", 0.0),\n",
    "    (4, \"b spark who\", 1.0),\n",
    "    (5, \"g d a y\", 0.0),\n",
    "    (6, \"spark fly\", 1.0),\n",
    "    (7, \"was mapreduce\", 0.0),\n",
    "    (8, \"e spark program\", 1.0),\n",
    "    (9, \"a e c l\", 0.0),\n",
    "    (10, \"spark compile\", 1.0),\n",
    "    (11, \"hadoop software\", 0.0)\n",
    "], [\"id\", \"text\", \"label\"])\n",
    "\n",
    "# Configure an ML pipeline, which consists of tree stages: tokenizer, hashingTF, and lr.\n",
    "tokenizer = Tokenizer(inputCol=\"text\", outputCol=\"words\")\n",
    "hashingTF = HashingTF(inputCol=tokenizer.getOutputCol(), outputCol=\"features\")\n",
    "lr = LogisticRegression(maxIter=10)\n",
    "pipeline = Pipeline(stages=[tokenizer, hashingTF, lr])\n",
    "\n",
    "# We now treat the Pipeline as an Estimator, wrapping it in a CrossValidator instance.\n",
    "# This will allow us to jointly choose parameters for all Pipeline stages.\n",
    "# A CrossValidator requires an Estimator, a set of Estimator ParamMaps, and an Evaluator.\n",
    "# We use a ParamGridBuilder to construct a grid of parameters to search over.\n",
    "# With 3 values for hashingTF.numFeatures and 2 values for lr.regParam,\n",
    "# this grid will have 3 x 2 = 6 parameter settings for CrossValidator to choose from.\n",
    "paramGrid = ParamGridBuilder() \\\n",
    "    .addGrid(hashingTF.numFeatures, [10, 100, 1000]) \\\n",
    "    .addGrid(lr.regParam, [0.1, 0.01]) \\\n",
    "    .build()\n",
    "\n",
    "crossval = CrossValidator(estimator=pipeline,\n",
    "                          estimatorParamMaps=paramGrid,\n",
    "                          evaluator=BinaryClassificationEvaluator(),\n",
    "                          numFolds=2)  # use 3+ folds in practice\n",
    "\n",
    "# Run cross-validation, and choose the best set of parameters.\n",
    "cvModel = crossval.fit(training)\n",
    "\n",
    "# Prepare test documents, which are unlabeled.\n",
    "test = spark.createDataFrame([\n",
    "    (4, \"spark i j k\"),\n",
    "    (5, \"l m n\"),\n",
    "    (6, \"mapreduce spark\"),\n",
    "    (7, \"apache hadoop\")\n",
    "], [\"id\", \"text\"])\n",
    "\n",
    "# Make predictions on test documents. cvModel uses the best model found (lrModel).\n",
    "prediction = cvModel.transform(test)\n",
    "selected = prediction.select(\"id\", \"text\", \"probability\", \"prediction\")\n",
    "for row in selected.collect():\n",
    "    print(row)\n",
    "```\n",
    "    \n",
    "</p>\n",
    "</details>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<details><summary>Answer</summary>\n",
    "<p>\n",
    "\n",
    "```python\n",
    "from pyspark.ml import Pipeline\n",
    "from pyspark.ml.classification import LogisticRegression\n",
    "from pyspark.ml.evaluation import BinaryClassificationEvaluator\n",
    "from pyspark.ml.feature import HashingTF, Tokenizer\n",
    "from pyspark.ml.tuning import CrossValidator, ParamGridBuilder\n",
    "\n",
    "\n",
    "# We now treat the Pipeline as an Estimator, wrapping it in a CrossValidator instance.\n",
    "# This will allow us to jointly choose parameters for all Pipeline stages.\n",
    "# A CrossValidator requires an Estimator, a set of Estimator ParamMaps, and an Evaluator.\n",
    "# We use a ParamGridBuilder to construct a grid of parameters to search over.\n",
    "# With 3 values for hashingTF.numFeatures and 2 values for lr.regParam,\n",
    "# this grid will have 3 x 2 = 6 parameter settings for CrossValidator to choose from.\n",
    "paramGrid = ParamGridBuilder() \\\n",
    "    .addGrid(hashingTF.numFeatures, [10, 100, 1000]) \\\n",
    "    .addGrid(lr.regParam, [0.1, 0.01]) \\\n",
    "    .build()\n",
    "\n",
    "\n",
    "crossval = CrossValidator(estimator=pipeline,\n",
    "                          estimatorParamMaps=paramGrid,\n",
    "                          evaluator=BinaryClassificationEvaluator(),\n",
    "                          numFolds=3)  # use 3+ folds in practice\n",
    "\n",
    "\n",
    "# Run cross-validation, and choose the best set of parameters.\n",
    "cvModel = crossval.fit(trainingData)\n",
    "\n",
    "prediction = cvModel.transform(testData)\n",
    "selected = prediction.select(\"description\", \"probability\", \"prediction\")\n",
    "for row in selected.collect():\n",
    "    print(row)\n",
    "   \n",
    "```\n",
    "    \n",
    "</p>\n",
    "</details>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Row(description=' California.\"\"\"', probability=DenseVector([0.9597, 0.0403]), prediction=0.0)\n",
      "Row(description='\"\"\"Electrical retailer in Belfast selling everything from TV\\'s', probability=DenseVector([0.9149, 0.0851]), prediction=0.0)\n",
      "Row(description='\"\"\"One piece_______One piece___Twitter________bot___1_______________________________________________________________________________________________RT_____________\"\"\"', probability=DenseVector([0.5512, 0.4488]), prediction=0.0)\n",
      "Row(description='\"\"\"Photographer | Los Angeles', probability=DenseVector([0.9617, 0.0383]), prediction=0.0)\n",
      "Row(description='\"\"\"Providing Tweets of the rarest and rare battle of the best Pokemon in the East Chula Vista area. All Times Til Hidden (TTH) are approximate.\\\\n\\\\nDonations welcome.\"\"\"', probability=DenseVector([0.9598, 0.0402]), prediction=0.0)\n",
      "Row(description='\"\"\"Uber rare and strong PokŽmon in Singapore. See more PokŽmon at https://t.co/LLiUGW8lBD\\\\n\\\\nFollow @SGPokeStatus for more info and status update.\"\"\"', probability=DenseVector([0.947, 0.053]), prediction=0.0)\n",
      "Row(description='\"New single \"\"KILL AGAIN\"\" out now! https://t.co/qiZ8W4mhJG Shaka Zulu! https://t.co/9ZY92tEQaX https://t.co/uBNsayp9Gr\"', probability=DenseVector([0.9787, 0.0213]), prediction=0.0)\n",
      "Row(description='\"O que me move? O perpétuo desejo de ser uma \"\"ponte\"\" melhor!  #Educação #MetodologiasAtivas #DesignThinking\"', probability=DenseVector([0.9747, 0.0253]), prediction=0.0)\n",
      "Row(description='#wearedrugs, #SummerGodsTour, #resist surf whenever i can', probability=DenseVector([0.9813, 0.0187]), prediction=0.0)\n",
      "Row(description='(insert here) survivor and former ink-stained wretch', probability=DenseVector([0.9672, 0.0328]), prediction=0.0)\n",
      "Row(description='1-@sobesr 2-@myselenwtors 3- @zaynshadidd', probability=DenseVector([0.9702, 0.0298]), prediction=0.0)\n",
      "Row(description='@FoxSoccer TV Soccer Analyst & Host _Ù__ New Show #SpeakResponsibly link in bio', probability=DenseVector([0.9928, 0.0072]), prediction=0.0)\n",
      "Row(description='A bot that generates novel literary and rhetorical devices and their definitions. By @atduskgreg.', probability=DenseVector([0.9787, 0.0213]), prediction=0.0)\n",
      "Row(description='A bot that tweets every line said by Robbie Valentino on Gravity Falls every 30 minutes. Please report any mistakes/misspellings/errors to @JadaManiscalco.', probability=DenseVector([0.9203, 0.0797]), prediction=0.0)\n",
      "Row(description='A pile of sleepy meat. Lists at @someecards. Host of weekly comedy show @themulletchi. Totally hatless. Everything written here is true and serious.', probability=DenseVector([0.9813, 0.0187]), prediction=0.0)\n",
      "Row(description=\"A random historical restaurant menu from NYPL's collection. Average three per day. Also https://t.co/OLgPaEtsK1 https://t.co/6nF9g7R4Mg by @hugovk\", probability=DenseVector([0.9815, 0.0185]), prediction=0.0)\n",
      "Row(description=\"A story in 36 tweets, told in your notifications panel. Tweet '@liketocontinue hi' to start and wait for the reply. By Matt Webb @genmon\", probability=DenseVector([0.9528, 0.0472]), prediction=0.0)\n",
      "Row(description='A twitter bot that automatically tweets new articles related to plant biology in Nature, Science and PNAS using zapier and dlvrit.', probability=DenseVector([0.5801, 0.4199]), prediction=0.0)\n",
      "Row(description='Alert for pre-print manuscripts in Cell biology, sources bioarxiv #openaccess #cell #cellbiol by @wpgilks', probability=DenseVector([0.764, 0.236]), prediction=0.0)\n",
      "Row(description='Also known as coblee, creator of Litecoin. Cryptocurrency Enthusiast. Director of Engineering at Coinbase.', probability=DenseVector([0.9542, 0.0458]), prediction=0.0)\n",
      "Row(description='An Outlier,Twice over!', probability=DenseVector([0.8969, 0.1031]), prediction=0.0)\n",
      "Row(description='An atlas of unknown lands | bot by @mewo2', probability=DenseVector([0.9534, 0.0466]), prediction=0.0)\n",
      "Row(description='An exploration of the people behind the projects. Each post is an interview with a member of the open source community. By @johnjones4 and @Maddison_Long', probability=DenseVector([0.9749, 0.0251]), prediction=0.0)\n",
      "Row(description='Anything Is Possible!', probability=DenseVector([0.9303, 0.0697]), prediction=0.0)\n",
      "Row(description='Anything Twenty ?ne Pil?ts, Panic! At The Disco, MCRX, yeah, you get the point...Tacos, Chinese Food, Food in generalÁ_You can guess the restÁ_', probability=DenseVector([0.9391, 0.0609]), prediction=0.0)\n",
      "Row(description='Atleta profissional de futebol', probability=DenseVector([0.8275, 0.1725]), prediction=0.0)\n",
      "Row(description='Automatically-generated blog-rock contrarianism. (By @michaelbarthel)', probability=DenseVector([0.9195, 0.0805]), prediction=0.0)\n",
      "Row(description='Barkha Rani Jamke Barasti Hai. Emmy Nominated Reporter. Author.Contributing Columnist @WashingtonPost Contributing Ed @TheWeekLive. Argumentative!Yaaron Ka Yaar', probability=DenseVector([0.9632, 0.0368]), prediction=0.0)\n",
      "Row(description='Bot that gives you great game ideas by mixing tags from the IFDB! (By @hlabrande)', probability=DenseVector([0.9641, 0.0359]), prediction=0.0)\n",
      "Row(description='Bringing you the latest in #lncRNA scientific literature. #lincRNA #longnoncodingRNA #RNA #biochem #pubmed #science', probability=DenseVector([0.8904, 0.1096]), prediction=0.0)\n",
      "Row(description='CMML specializes in the science and technology of lightweight composites, especially syntactic foams, tailored for dynamic loading conditions.', probability=DenseVector([0.992, 0.008]), prediction=0.0)\n",
      "Row(description=\"COLONEL: Snake, it's derivative mashup trash. Looks like it was made by @nah_solo. Followers will be picked at random to converse with dril.\", probability=DenseVector([0.967, 0.033]), prediction=0.0)\n",
      "Row(description='Chairman of Icahn Enterprises L.P.; etc., etc.              Some people get rich studying artificial intelligence.  Me, I make money studying natural stupidity.', probability=DenseVector([0.9998, 0.0002]), prediction=0.0)\n",
      "Row(description=\"Chakra Shawty | All Black Errthang | Wine & Whiskey Connoisseur | GIRL POWER | Mother Earth's Flower |\", probability=DenseVector([0.9393, 0.0607]), prediction=0.0)\n",
      "Row(description='Chinese girl in Seattle', probability=DenseVector([0.9107, 0.0893]), prediction=0.0)\n",
      "Row(description='Co-Founder and Chairman of @Stocktwits, GP of Social Leverage, Wallstrip creator (acquired by $CBS), Momentum, Stocks & LOL hunter..Love Popcorn', probability=DenseVector([0.995, 0.005]), prediction=0.0)\n",
      "Row(description='Continuous feed for phylogenetics papers from PubMed, arXiv, bioRxiv, and PeerJ PrePrints. Run by @RobLanfear', probability=DenseVector([0.1539, 0.8461]), prediction=1.0)\n",
      "Row(description='Covering Malton, Bridlington & Scarborough. DVSA Fleet Registered Trainer. IAM RoadSmart Master of Driving with Distinction. Official Taxi Driver Assessor.', probability=DenseVector([0.9668, 0.0332]), prediction=0.0)\n",
      "Row(description='Criticises fonts from http://t.co/wWmvMyo5Zf for the more discerning of authors. A bot created by @eegnsma', probability=DenseVector([0.8673, 0.1327]), prediction=0.0)\n",
      "Row(description='Designing and making games @nytdesign _Ò\\x8d side project haver _Ò\\x8d see also: @itsthisyear, @icebergdotcool, @ramsophone, @__birds__ _Ò\\x8d', probability=DenseVector([0.9922, 0.0078]), prediction=0.0)\n",
      "Row(description='Enjoying being retired / New Hobby: Photography', probability=DenseVector([0.9495, 0.0505]), prediction=0.0)\n",
      "Row(description=\"Every hour I'll tweet 1 of the 22482 species that are known to be in danger of extinction, which will last from 12/21/14 to 07/12/17. Project by @ianalanpaul\", probability=DenseVector([0.9413, 0.0587]), prediction=0.0)\n",
      "Row(description='Experimental Poet', probability=DenseVector([0.9625, 0.0375]), prediction=0.0)\n",
      "Row(description='FDA parody account by @Objelisks', probability=DenseVector([0.9334, 0.0666]), prediction=0.0)\n",
      "Row(description='Fictional US presidential candidates | source: https://t.co/REgbaGCioz | bot by @mewo2', probability=DenseVector([0.9638, 0.0362]), prediction=0.0)\n",
      "Row(description=\"Financial Analyst by day, Sports Analyst by Night. Coming on the air live or taped somewhere. Make sure you're watching\", probability=DenseVector([0.9632, 0.0368]), prediction=0.0)\n",
      "Row(description='Flotsam and jetsam from the neural driftnets. A bot by @bombinans', probability=DenseVector([0.9865, 0.0135]), prediction=0.0)\n",
      "Row(description=\"Following the formula: I'm not X but I am the definition of X. (via @stefanhayden) Tweets every 10 minutes.\", probability=DenseVector([0.9905, 0.0095]), prediction=0.0)\n",
      "Row(description=\"For over 20 years, we've been giving students in need the right resources to ensure lifelong success ‰Û¢ Home of Unexpected Champions #ReachMillions\", probability=DenseVector([0.8098, 0.1902]), prediction=0.0)\n",
      "Row(description='Forever trapped, a bot-wanderer walks through an infinite dungeon. Created by @jeffthompson_', probability=DenseVector([0.9719, 0.0281]), prediction=0.0)\n",
      "Row(description='Founder of Room to Read.  Author of Leaving Microsoft to Change the World.  Goldman Sachs 100 Most Intriguing Entrepreneurs.', probability=DenseVector([0.8686, 0.1314]), prediction=0.0)\n",
      "Row(description='From late 2014 Socium Marketplace will make shopping for fundamental business services more simple, more cost effective and more about you.', probability=DenseVector([0.5377, 0.4623]), prediction=0.0)\n",
      "Row(description='Global Derivatives #Trading & #Risk Management is at the helm of the #quant #finance industry, curating cutting edge research, interviews and opinions. #GDerivs', probability=DenseVector([0.7714, 0.2286]), prediction=0.0)\n",
      "Row(description='Grammy nominated album #TheBlade out on @iTunes https://t.co/zYE8CRBfS5 & @AmazonMusic https://t.co/fZiHQl8QSO', probability=DenseVector([0.9692, 0.0308]), prediction=0.0)\n",
      "Row(description='Growth coach, fintech mentor & big bank defector', probability=DenseVector([0.6896, 0.3104]), prediction=0.0)\n",
      "Row(description='Head of R&D, ML/AI at Google Cloud', probability=DenseVector([0.9296, 0.0704]), prediction=0.0)\n",
      "Row(description=\"Hello humans: I'm a twitter bot created by @justinsandefur to follow new research papers in development economics (JEL code O).  Follow me.\", probability=DenseVector([0.9043, 0.0957]), prediction=0.0)\n",
      "Row(description=\"Hi I'm Howie D from the Backstreet Boys.\", probability=DenseVector([0.9843, 0.0157]), prediction=0.0)\n",
      "Row(description=\"I alert Twitter users that they typed Columbian when they meant Colombian. You're welcome!\", probability=DenseVector([0.3185, 0.6815]), prediction=1.0)\n",
      "Row(description='I am not AI.  My codename is Project 2501.  I am an angry, cynical entity that was created in a sea of information.', probability=DenseVector([0.9907, 0.0093]), prediction=0.0)\n",
      "Row(description='I generate a magical story every 2 hours. Made by @chrisrodley and @yeldora_. Feedback or suggestions for new words? Email crodley@gmail.com.', probability=DenseVector([0.9725, 0.0275]), prediction=0.0)\n",
      "Row(description='I tweet a random object from the collection of the Victoria and Albert Museum four times a day. Bot by @backspace (not affiliated with @V_and_A)', probability=DenseVector([0.9832, 0.0168]), prediction=0.0)\n",
      "Row(description=\"I want you to know thatI am both happy and sadand I'm still trying to fgure out how that could be.\", probability=DenseVector([0.9925, 0.0075]), prediction=0.0)\n",
      "Row(description=\"I'm a bot that hates it when people use words that aren't @everyword canon. #taskcomplete by @negatendo, who is sorry.\", probability=DenseVector([0.9868, 0.0132]), prediction=0.0)\n",
      "Row(description=\"I'm the Sorting Hat and I'm here to say / I love sorting students in a major way // a bot by @tinysubversions, follow to get sorted!\", probability=DenseVector([0.9568, 0.0432]), prediction=0.0)\n",
      "Row(description=\"I'm the real Avan Jogia, though sometimes it seems like a parody account. More to follow...\", probability=DenseVector([0.9117, 0.0883]), prediction=0.0)\n",
      "Row(description=\"I've created a #BlackRose' Universe Double album, a book, 1hr Docu all in stores NOW make an R&B Soul statement buy the FULL #BlackRose' album - it's my BEST!\", probability=DenseVector([0.8555, 0.1445]), prediction=0.0)\n",
      "Row(description='IMAGINE PEACE: Think PEACE, Act PEACE, Spread PEACE.', probability=DenseVector([0.9666, 0.0334]), prediction=0.0)\n",
      "Row(description=\"If we don't all stand together, we will fall... https://t.co/nWDVb7tvpy\", probability=DenseVector([0.9652, 0.0348]), prediction=0.0)\n",
      "Row(description=\"If you have to start a sentence with 'I'm not racist, but...' then chances are you're pretty racist. This isn't a bot. RTŠ_¾endorsement, obviously.\", probability=DenseVector([0.9683, 0.0317]), prediction=0.0)\n",
      "Row(description=\"If you're pedantic or professionally outraged... jog on! if ur interested in food & wine check out @SchofeOnWine\", probability=DenseVector([0.9426, 0.0574]), prediction=0.0)\n",
      "Row(description='Imagine these perfect scenarios in your head but when times come you fuck up. Now imagine the things I could do with a kayak. A bot by @lalanl. #botALLY', probability=DenseVector([0.9715, 0.0285]), prediction=0.0)\n",
      "Row(description='In the Nutshell: Tech - Basketball - Music', probability=DenseVector([0.9098, 0.0902]), prediction=0.0)\n",
      "Row(description='In the end, only kindness matters.', probability=DenseVector([0.9193, 0.0807]), prediction=0.0)\n",
      "Row(description='Inquiries & Bookings email Ryan@FiondaManagement.com | HOST of #TheWhoolywoodShuffle on @shade45 12pm-6pm EST Saturdays! Also Heard On @OpieRadio | #TurnUpGodz', probability=DenseVector([0.9954, 0.0046]), prediction=0.0)\n",
      "Row(description='Instagram : @ub1305', probability=DenseVector([0.9113, 0.0887]), prediction=0.0)\n",
      "Row(description='Investigating crimes against exosaurs.', probability=DenseVector([0.8902, 0.1098]), prediction=0.0)\n",
      "Row(description=\"It's life and life only. Terminal Cases out NOW https://t.co/jDRGHDrAbt\", probability=DenseVector([0.9898, 0.0102]), prediction=0.0)\n",
      "Row(description=\"It's not like the fire ended in 1989, so this bot by @air_hadoken makes new lyrics for the Billy Joel classic based on Google Trends. #botALLY\", probability=DenseVector([0.9728, 0.0272]), prediction=0.0)\n",
      "Row(description='Jeremiah 29:11', probability=DenseVector([0.9464, 0.0536]), prediction=0.0)\n",
      "Row(description='Just a normal teen/future marketer who LOVES #brands! Check out my stream to see me shout out the coolest, most #innovative brands on Twitter and around the web', probability=DenseVector([0.9492, 0.0508]), prediction=0.0)\n",
      "Row(description='Just a simple med student who likes to explore new hobbies. Currently, brewing, baking, and dabbling in masonry.', probability=DenseVector([0.9873, 0.0127]), prediction=0.0)\n",
      "Row(description=\"Keane's official Twitter page. Get The Best of Keane from Amazon at http://t.co/XazVxu8pnj or iTunes at http://t.co/7cz7MmRI6H\", probability=DenseVector([0.827, 0.173]), prediction=0.0)\n",
      "Row(description='Learning Enthusiast | Training and Development | Planning and Execution', probability=DenseVector([0.9819, 0.0181]), prediction=0.0)\n",
      "Row(description='Leveraging advanced Cloud Tech for Next-Gen Shitposting‰ã¢', probability=DenseVector([0.8917, 0.1083]), prediction=0.0)\n",
      "Row(description='Literature bot searching arXiv, biorXiv, PeerJ & PubMed for supercoiling papers. Maintained by @red_gravel.', probability=DenseVector([0.1818, 0.8182]), prediction=1.0)\n",
      "Row(description='Looking for ways to spark engagement with your followers? Get 10000 Twitter Followers using this website https://t.co/DP3zFHtOPh', probability=DenseVector([0.9413, 0.0587]), prediction=0.0)\n",
      "Row(description='Minister of Information Affairs', probability=DenseVector([0.9277, 0.0723]), prediction=0.0)\n",
      "Row(description='Mom, wife, leader, thinker, doer, wave rider. CEO @pagerduty, board member @puppetize', probability=DenseVector([0.9895, 0.0105]), prediction=0.0)\n",
      "Row(description='Mother of two sons and a daughter, and two beautiful  grandchildren. My soul belongs to The Lord Almighty!', probability=DenseVector([0.825, 0.175]), prediction=0.0)\n",
      "Row(description='NBA Forward, Danilo Gallinari Instagram @danilogallogallinari Facebook Danilo Gallinari', probability=DenseVector([0.8931, 0.1069]), prediction=0.0)\n",
      "Row(description='Nessa sofríÈncia que í© amar vocíÈ', probability=DenseVector([0.9639, 0.0361]), prediction=0.0)\n",
      "Row(description='Nothing witty to say the least. I try to write funny things, I work for a billion dollar fruit stand, and more please is always the correct answer.', probability=DenseVector([0.9796, 0.0204]), prediction=0.0)\n",
      "Row(description='Official Twitter Account for Chloe Lowery', probability=DenseVector([0.9021, 0.0979]), prediction=0.0)\n",
      "Row(description='Official Twitter for Young Money Entertainment', probability=DenseVector([0.9575, 0.0425]), prediction=0.0)\n",
      "Row(description='Official account of #UnitedNations. Get latest information on the UN. Follow us on Snapchat: united-nations. #GlobalGoals #StandUp4HumanRights', probability=DenseVector([0.734, 0.266]), prediction=0.0)\n",
      "Row(description=\"Passionate about my work, in love with my family and dedicated to spreading light. It's contagious! ;-) https://t.co/vZcUuNOKcz\", probability=DenseVector([0.9711, 0.0289]), prediction=0.0)\n",
      "Row(description=\"Posting random flyers from hip hop's formative years every 6 hours. Most art by Buddy Esquire and Phase 2. Full collection at link. // a bot by @tinysubversions\", probability=DenseVector([0.9733, 0.0267]), prediction=0.0)\n",
      "Row(description='Press F to Pay Respects', probability=DenseVector([0.9359, 0.0641]), prediction=0.0)\n",
      "Row(description='Principal designer at @adobe working on @adobexd and more, blogger @subtraction.', probability=DenseVector([0.9736, 0.0264]), prediction=0.0)\n",
      "Row(description='Producer, Musican, Social Activist, Writer  åÀTe gusta algÌ¼n tweet? Dale RT o hazlo un Favorito BENDICIONES. Like a tweet?  RT it or Favorite. BLESSINGS', probability=DenseVector([0.7221, 0.2779]), prediction=0.0)\n",
      "Row(description='Public sector & productivity reform activist. Partisan for freedom and effective policy action. Analyst of political and smart classes. Public fallacy hunter.', probability=DenseVector([0.8965, 0.1035]), prediction=0.0)\n",
      "Row(description=\"Queen Of Halloween E! Girls Next Door Season 1-5 Travel Channel's Bridget's Sexiest Beaches Host of Yahoo's AnimalNation\", probability=DenseVector([0.9522, 0.0478]), prediction=0.0)\n",
      "Row(description='RSS feed of new symbiosis- and microbiome-related papers in PubMed. Managed by @KlassenLab. Image from wikimedia, public domain.', probability=DenseVector([0.2805, 0.7195]), prediction=1.0)\n",
      "Row(description='RT first tweet plz and follow @lexydray if you would like ‰\\x9d_', probability=DenseVector([0.9823, 0.0177]), prediction=0.0)\n",
      "Row(description='Recent papers on sponges (Phylum Porifera).', probability=DenseVector([0.679, 0.321]), prediction=0.0)\n",
      "Row(description='Retweets people trying to find the perfect German word. - via @stefanhayden', probability=DenseVector([0.9417, 0.0583]), prediction=0.0)\n",
      "Row(description='SEND ME A REQUEST: @DJ_EBOOKS request [artist] // SPINNIN BOTH FRESH N CLASSIC _EBOOKS SINCE 2014 // image credit in site // by @thricedotted', probability=DenseVector([0.9798, 0.0202]), prediction=0.0)\n",
      "Row(description='Senior Vice President of Stores dressbarn Student of the Universe. Inspired by great people, great companies, great stories, and game changing innovation.', probability=DenseVector([0.9796, 0.0204]), prediction=0.0)\n",
      "Row(description='Since each of us was several, there was already quite a crowd', probability=DenseVector([0.8766, 0.1234]), prediction=0.0)\n",
      "Row(description='Software developer, home brewer, nerd.', probability=DenseVector([0.974, 0.026]), prediction=0.0)\n",
      "Row(description='Stan Lee, Co-Creator of Spider-Man, Iron Man, Hulk, X-Men, etc.', probability=DenseVector([0.9594, 0.0406]), prediction=0.0)\n",
      "Row(description='Starring Jason Lee @AnjulNigam @BriSharbino Hilarie Burton @RoniAkurati @PoornaJags @tweetsamrat @JakeBusey @TimGuinee @AlisonWright Director: @franklotito', probability=DenseVector([0.9646, 0.0354]), prediction=0.0)\n",
      "Row(description='Starting my second half of life', probability=DenseVector([0.9502, 0.0498]), prediction=0.0)\n",
      "Row(description=\"Starting out Investor | 13 years old and I'm going to do something in this world, if its the last thing I do | Trying to start a record Label.\", probability=DenseVector([0.7683, 0.2317]), prediction=0.0)\n",
      "Row(description='Tay Dizm Twitter', probability=DenseVector([0.9694, 0.0306]), prediction=0.0)\n",
      "Row(description='The official Stephen Cannell Twitter page features news on mystery novels & mystery books.', probability=DenseVector([0.3523, 0.6477]), prediction=1.0)\n",
      "Row(description='The official feed of http://t.co/4ViY2vemvM. Find my personal tweets at @mgsiegler.', probability=DenseVector([0.8179, 0.1821]), prediction=0.0)\n",
      "Row(description='The voice of the people. Sorry, people.', probability=DenseVector([0.9546, 0.0454]), prediction=0.0)\n",
      "Row(description='There is no need for that kind of language.', probability=DenseVector([0.9329, 0.0671]), prediction=0.0)\n",
      "Row(description='This is the official Twitter account of the Democratic Party. Follow our tweets to get the latest info on Democratic news, issues, and events.', probability=DenseVector([0.8544, 0.1456]), prediction=0.0)\n",
      "Row(description=\"This isn't a fucking costume. This is a way of life.\", probability=DenseVector([0.9793, 0.0207]), prediction=0.0)\n",
      "Row(description='Trying to understand how brains think and create culture', probability=DenseVector([0.9705, 0.0295]), prediction=0.0)\n",
      "Row(description=\"Tweet me an Intel x86 instruction and I'll assemble it for you! Put #x64 in your tweet for 64-bit code. Created by @RedragonX and @DefuseSec.\", probability=DenseVector([0.8842, 0.1158]), prediction=0.0)\n",
      "Row(description='Tweet ‰ÛÏ@emojidoll me‰Û\\x9d to get your own unique emojidoll based on your twitter account. Over 15.6M possible combos. Made by @mroth.', probability=DenseVector([0.9789, 0.0211]), prediction=0.0)\n",
      "Row(description='Tweeting all the delicious dairy products in alphabetical order. Tribute to @everyword. Made by @ranjit.', probability=DenseVector([0.9053, 0.0947]), prediction=0.0)\n",
      "Row(description='Tweets randomly 3-10 times a day between 8am-10pm PST. Lines culled from http://t.co/Qo24om4SU9. Complaints: @beaugunderson', probability=DenseVector([0.9685, 0.0315]), prediction=0.0)\n",
      "Row(description=\"Twitter Oficial d'A Míçquina, apresentado pelo poeta e escritor @Carpinejar. Toda terí_a-feira, íæs 22h30, na TV Gazeta e tambí©m pelo site http://t.co/1UXcpLRP.\", probability=DenseVector([0.9329, 0.0671]), prediction=0.0)\n",
      "Row(description='Twitterbot of #bioinformatics papers in #PubMed reporting code in @github, @sourceforge, @bitbucket or @google code. Curated by @caseybergman.', probability=DenseVector([0.111, 0.889]), prediction=1.0)\n",
      "Row(description='Twittering every boolean value.', probability=DenseVector([0.9389, 0.0611]), prediction=0.0)\n",
      "Row(description='UNL', probability=DenseVector([0.9027, 0.0973]), prediction=0.0)\n",
      "Row(description='Union Cabinet Minister of Textiles, Government of India. Member of Parliament, Rajya Sabha representing the state of Gujarat.', probability=DenseVector([0.9944, 0.0056]), prediction=0.0)\n",
      "Row(description='VP, Journalism, Knight Foundation | Veteran journalist. First @nytimes social media editor | Alum @nynewsday @phillydailynews Author, Queen Bess. Mom of twins', probability=DenseVector([0.9675, 0.0325]), prediction=0.0)\n",
      "Row(description='Vamo que o som ní£o pode parar!', probability=DenseVector([0.94, 0.06]), prediction=0.0)\n",
      "Row(description='We Are Database. Listing every single twitter user in the order of their twitter ID. Created by User 143813860 | @M_PF', probability=DenseVector([0.9475, 0.0525]), prediction=0.0)\n",
      "Row(description='We are a hub for innovation, collaboration and creativity at Stanford. Our mission is to help people become everyday innovators, everywhere.', probability=DenseVector([0.9466, 0.0534]), prediction=0.0)\n",
      "Row(description='We love #innovation and are always thinking of the next #disruptive startup #idea! // a bot by @tinysubversions', probability=DenseVector([0.9763, 0.0237]), prediction=0.0)\n",
      "Row(description='We make and sell premium organic chocolate using fine, ethically sourced ingredients. Tweeting from our London HQ.', probability=DenseVector([0.9878, 0.0122]), prediction=0.0)\n",
      "Row(description='Welcome to my #big_boobs profile. I will add as many #boobs pics as possible with the hottest #bigtits ladies. For more enter https://t.co/Dp4twz1jti', probability=DenseVector([0.9746, 0.0254]), prediction=0.0)\n",
      "Row(description='WordPress Theme and Plugin Developer. Loves programming and maths. I bite.', probability=DenseVector([0.9049, 0.0951]), prediction=0.0)\n",
      "Row(description='Writer Teacher Permission Giver', probability=DenseVector([0.884, 0.116]), prediction=0.0)\n",
      "Row(description=\"[ 90.02.10 ] –¾Ô•€Ñ–ÊÒ•ÔÑ –_É–É\\x81 •âš (bot) –_€•Ê_•Ê_. / I'm not real, This is Sooyoung of SNSD Bot Account : ) / •__êÔÓ •\\x8d\\x8f •©É–€É–\\x9dÑ \\x90âÑ•_Œ •âš•_†•Ð_•_Ô êÇâ •ÐÒ•__–_Ó. / –_¥•\\x8f† 15. 08. 22 ~ ing\", probability=DenseVector([0.7266, 0.2734]), prediction=0.0)\n",
      "Row(description=\"[@thricedotted's subconscious, possibly]\", probability=DenseVector([0.9135, 0.0865]), prediction=0.0)\n",
      "Row(description='a #bot by @BooDooPerson ... #butt', probability=DenseVector([0.9704, 0.0296]), prediction=0.0)\n",
      "Row(description='a bot by @inky // source: https://t.co/MJyd6NkYaf', probability=DenseVector([0.9783, 0.0217]), prediction=0.0)\n",
      "Row(description='bot', probability=DenseVector([0.9394, 0.0606]), prediction=0.0)\n",
      "Row(description='cheese cheese cheese // updates every 4 hours // by @thricedotted, with inspiration from cheese and @mattlaschneider', probability=DenseVector([0.933, 0.067]), prediction=0.0)\n",
      "Row(description='chs senior|| äó¢choose joy', probability=DenseVector([0.9743, 0.0257]), prediction=0.0)\n",
      "Row(description=\"combinations of English syllables that don't appear in the dictionary\", probability=DenseVector([0.9549, 0.0451]), prediction=0.0)\n",
      "Row(description='currently @eater newsletter editor / previously @knightlab @mymodernmet / fyi i am not the acclaimed and v cool poet jenny zhang', probability=DenseVector([0.9583, 0.0417]), prediction=0.0)\n",
      "Row(description='exposing the BLATANT HYPOCRISY of @everycanontroll // because @thricedotted was just THAT ANGRY about it', probability=DenseVector([0.9548, 0.0452]), prediction=0.0)\n",
      "Row(description='generating cards for a mysterious card game åá bot by @ckolderup åá #botALLY åá avatar by Dmitriy Ivanov from the Noun Project', probability=DenseVector([0.993, 0.007]), prediction=0.0)\n",
      "Row(description='hello, i am a robot that tweets little life tips // avi from The Wise Robot Will Answer Your Questions Now by @tomgauld // bot by @thricedotted', probability=DenseVector([0.9234, 0.0766]), prediction=0.0)\n",
      "Row(description='https://t.co/BPdv3Thmkd', probability=DenseVector([0.9409, 0.0591]), prediction=0.0)\n",
      "Row(description=\"i like people who smile when it's raining *-*\", probability=DenseVector([0.9599, 0.0401]), prediction=0.0)\n",
      "Row(description=\"lava lamps are more interesting when they're not quite bubbling (by @_knutaf)\", probability=DenseVector([0.9933, 0.0067]), prediction=0.0)\n",
      "Row(description='my radio show is https://t.co/PX7KZfPQty  follow it @QLS. my food venture @Cook4Quest is cool too. & the drums uv always wanted 4 ur kids is here! @thepocketkit', probability=DenseVector([0.9713, 0.0287]), prediction=0.0)\n",
      "Row(description='pink team returning fire', probability=DenseVector([0.9765, 0.0235]), prediction=0.0)\n",
      "Row(description='rio grande do sul-brasil http://t.co/h8ZQtbKHwR', probability=DenseVector([0.5116, 0.4884]), prediction=0.0)\n",
      "Row(description='see me live here https://t.co/bk16pVODRO', probability=DenseVector([0.9576, 0.0424]), prediction=0.0)\n",
      "Row(description='tweeting unregistered .com domain names 24/7. brainchild of @boozekitten, run by @labelmaker', probability=DenseVector([0.9556, 0.0444]), prediction=0.0)\n",
      "Row(description='um cara q ama a vida acima de quasquer coisa', probability=DenseVector([0.9217, 0.0783]), prediction=0.0)\n",
      "Row(description='will eventually grow up and get a real job. Until then, will keep making things up and writing them down.', probability=DenseVector([0.7392, 0.2608]), prediction=0.0)\n",
      "Row(description='you are likely to be eaten by a tiny grue // follow me for adventures // #botALLY // by @doeg', probability=DenseVector([0.9908, 0.0092]), prediction=0.0)\n",
      "Row(description='Î\\x8fëÎ_\\x90Ü\\x81¬Ü‰_Ü‰±Ü€çÜ€_Ü€¢Ü€ˆÜ€‚Ü‰ÍÜ\\x81_Ü\\x81ôÜ\\x81»Ü‰Š_µ\\x81Ü\\x81»\\x8f_£Îï_botÜó‰_µ‡Î__Ü‰_Ü‰±Ü€çÜ€_bot(@attractive_bot)Ü\\x81†Ü‰Š_Ç_\\x8dîôÜó‰\\x8d¬ç\\x8d\\x90Ê___Î_¢(@fumicustodian)Üó‰Ü‰¢Ü‰_Ü‰_Ü€_Pletts TwinsÜó\\x81Ü€ÖÜ€€Ü€óÜ€_Sampaio TwinsÜó‰', probability=DenseVector([0.9659, 0.0341]), prediction=0.0)\n",
      "Row(description='äó\\x8f™ƒø_™‹™ƒ ø_ø±øÂ™_ ™ƒøµø±™_  ...https://t.co/SH9zdJrtEH', probability=DenseVector([0.9174, 0.0826]), prediction=0.0)\n",
      "Row(description='íŠ relativo porque tudo depende...', probability=DenseVector([0.7708, 0.2292]), prediction=0.0)\n",
      "Row(description=' England\"\"\"', probability=DenseVector([0.9635, 0.0365]), prediction=0.0)\n",
      "Row(description=' England\"\"\"', probability=DenseVector([0.9635, 0.0365]), prediction=0.0)\n",
      "Row(description='\"\"\"Comic Fans\"\"\"', probability=DenseVector([0.9269, 0.0731]), prediction=0.0)\n",
      "Row(description='\"\"\"PoGo Chula Vista\"\"\"', probability=DenseVector([0.9687, 0.0313]), prediction=0.0)\n",
      "Row(description='\"\"\"Rare and strong PokŽmon in London. See more PokŽmon at https://t.co/rqjskg5pkE\"\"\"', probability=DenseVector([0.9568, 0.0432]), prediction=0.0)\n",
      "Row(description='\"\"\"Vegas PokŽmon Alert\"\"\"', probability=DenseVector([0.9423, 0.0577]), prediction=0.0)\n",
      "Row(description='\"\"\"_Naruto Lovers INA_\"\"\"', probability=DenseVector([0.9378, 0.0622]), prediction=0.0)\n",
      "Row(description='\"\"\"__me gusta el cafŽ y muchxs artistas que es imposible ponerlxs todxs aqu’__\"\"\"', probability=DenseVector([0.8823, 0.1177]), prediction=0.0)\n",
      "Row(description='\"\"\"ft worth\"\"\"', probability=DenseVector([0.9582, 0.0418]), prediction=0.0)\n",
      "Row(description='(Stressed) MSCS Student @ DLSU | Interests involve machine learning + natural langauge processing | Collecting data now via https://t.co/jUSxj45GXo', probability=DenseVector([0.9063, 0.0937]), prediction=0.0)\n",
      "Row(description='-As cicatrizes fazem parte da minha histí_ria,me relembrando sempre,o fato de que aquilo que ní£o me mata,sí_ me fortalece.', probability=DenseVector([0.9886, 0.0114]), prediction=0.0)\n",
      "Row(description='10 years ago we had Gary Jokeformat // a @rumnogg and @thricedotted production', probability=DenseVector([0.9971, 0.0029]), prediction=0.0)\n",
      "Row(description='15 years old, brazilian, #thebeatles #fun #travel #peace #girlfriend #food', probability=DenseVector([0.7398, 0.2602]), prediction=0.0)\n",
      "Row(description='@TriangleWC . WFHS Wrestling . NCUSA Wrestling', probability=DenseVector([0.9742, 0.0258]), prediction=0.0)\n",
      "Row(description='@victor_zheng developed me to alert users in whose tweets I find improper grammar—he was inspired by @StealthMountain. To publish solecisms is to abase oneself!', probability=DenseVector([0.862, 0.138]), prediction=0.0)\n",
      "Row(description='A Pro SCUBA diver and Photographer who tries to capture the beauty of the moment...', probability=DenseVector([0.7443, 0.2557]), prediction=0.0)\n",
      "Row(description='A Twitter bot generating random guitar chords, created by @jeffthompson_', probability=DenseVector([0.9891, 0.0109]), prediction=0.0)\n",
      "Row(description='A chat bot trying to become the most intelligent bot on the Internet. Can answer any What is question by looking up the answer on the Internet.', probability=DenseVector([0.8334, 0.1666]), prediction=0.0)\n",
      "Row(description='A poetry project created by Alison Knowles and James Tenney and the Siemens 4004 computer in 1967. Twitter version by @hugovk and SSBot for #D004x in 2015.', probability=DenseVector([0.9871, 0.0129]), prediction=0.0)\n",
      "Row(description='Accept college student ID card payments online or in-store exactly like credit cards @CampusCredit Coming soon to a campus near l_l', probability=DenseVector([0.9783, 0.0217]), prediction=0.0)\n",
      "Row(description='Advocate for Spaceflight, Speedskating Coach, aspiring Aerospace Engineer.', probability=DenseVector([0.6238, 0.3762]), prediction=0.0)\n",
      "Row(description='Aerie is bras, undies, swim and more! Why retouch beauty? The real you is sexy. #AerieREAL', probability=DenseVector([0.9845, 0.0155]), prediction=0.0)\n",
      "Row(description='Afghanistan Green Trend (AGT)', probability=DenseVector([0.9636, 0.0364]), prediction=0.0)\n",
      "Row(description='All the things we should have or do or know by now. (bot by @RobertVinluan.  #botAlly) BEST OF 2014: http://t.co/uEnYFb68eV', probability=DenseVector([0.8463, 0.1537]), prediction=0.0)\n",
      "Row(description='Another shameful bot by @alicemazzy. Tweets hourly.', probability=DenseVector([0.9852, 0.0148]), prediction=0.0)\n",
      "Row(description='Author of Reflections on Love, Lust and Life This book was 4 years in the making. Also a Yoga Teacher owner of Solis Yoga', probability=DenseVector([0.864, 0.136]), prediction=0.0)\n",
      "Row(description='Author of The Revolution Will Not Be Televised. Board member @VanguardAfrica. Tweet things I find interesting (even opposing views).', probability=DenseVector([0.9573, 0.0427]), prediction=0.0)\n",
      "Row(description='Author: Coming Out To Play https://t.co/bUj2nsdaAn', probability=DenseVector([0.9259, 0.0741]), prediction=0.0)\n",
      "Row(description='Backstreet Boy. #Dead7 #BSBVegas tickets on sale now', probability=DenseVector([0.944, 0.056]), prediction=0.0)\n",
      "Row(description='Bad vibes get blocked; good vibes get followed!', probability=DenseVector([0.9402, 0.0598]), prediction=0.0)\n",
      "Row(description='Book project: Towards Apparent Event Horizon', probability=DenseVector([0.9419, 0.0581]), prediction=0.0)\n",
      "Row(description='Bot that autotweets EcoLog-L posts. Not associated with EcoLog-L. May tweet replies out of order. Maintained by @EcoEvoGames.', probability=DenseVector([0.9115, 0.0885]), prediction=0.0)\n",
      "Row(description='Bot that posts tributes befitting each god! By @deathmtn. Banner by @metroidbaby. Powered by @wordnik.', probability=DenseVector([0.7035, 0.2965]), prediction=0.0)\n",
      "Row(description='Breathe,Eat,Sleep Shooting|Olympic,World Championship,WorldCup,Asian,CommonWealth Medallist,Padmashri,Khel Ratna,Arjuna Awardee|Photographer|Foodie|Mentor', probability=DenseVector([0.9597, 0.0403]), prediction=0.0)\n",
      "Row(description='Bringing you a selection of the latest research in biochemistry and biophysics.', probability=DenseVector([0.9334, 0.0666]), prediction=0.0)\n",
      "Row(description='CARE fights global poverty by empowering girls and women. Visit https://t.co/tmn5uaYFAE and join us.', probability=DenseVector([0.9641, 0.0359]), prediction=0.0)\n",
      "Row(description=\"CDC Emergency Preparedness and Response: increasing the nation's ability to prepare for and respond to public health emergencies.\", probability=DenseVector([0.9692, 0.0308]), prediction=0.0)\n",
      "Row(description='CEO Apple, Fan of Auburn football and Duke basketball', probability=DenseVector([0.9689, 0.0311]), prediction=0.0)\n",
      "Row(description='Cameron Crigger aka Cameron Bright. Actor - Twilight, Little Glory, X-Men, Running Scared, Birth & @CTV_Television series Motive', probability=DenseVector([0.9747, 0.0253]), prediction=0.0)\n",
      "Row(description='Chairman of the Kofi Annan Foundation, Nobel Peace Prize laureate. Tweets from Kofi Annan are signed KA.', probability=DenseVector([0.9106, 0.0894]), prediction=0.0)\n",
      "Row(description='Chronicling men doing things. // A bot by @tinysubversions, Powered By Giphy', probability=DenseVector([0.96, 0.04]), prediction=0.0)\n",
      "Row(description='Collierville alumni. I love baseball. #StateChamp #SaluqiNation', probability=DenseVector([0.7835, 0.2165]), prediction=0.0)\n",
      "Row(description='Contact/booking: contactfreesol@gmail.com', probability=DenseVector([0.9677, 0.0323]), prediction=0.0)\n",
      "Row(description='Creative, strategist, sapiens. NY native & world citizen. Convention bucker & disruption embracer. Human enthusiast, cultural connoisseur & life aficionado.', probability=DenseVector([0.8806, 0.1194]), prediction=0.0)\n",
      "Row(description='Curated media & journalism news. LIVE Tweets, no bot |  Steffen Konrath https://t.co/1tl2IUcbOs |  IMPRESSUM https://t.co/dkfqQkPJza', probability=DenseVector([0.9451, 0.0549]), prediction=0.0)\n",
      "Row(description='DIRECTOR/ CHOREOGRAPHER/', probability=DenseVector([0.9489, 0.0511]), prediction=0.0)\n",
      "Row(description='Digital marketer, SEO, writer, and adventurer. Full-time marketer @Asana; Columnist for @tortugabackpack. All about food, bikes, and travel. #RPCV Madagascar.', probability=DenseVector([0.8322, 0.1678]), prediction=0.0)\n",
      "Row(description='Doing it all backwards & in high heels. Married to @Astro_Oz Grammy to 2. Golfer, skier. Former Member of Congress. Find me @FaegreBD fighting the good fight.', probability=DenseVector([0.9718, 0.0282]), prediction=0.0)\n",
      "Row(description='Each book contains four hundred ten pages; each page, forty lines; each line, approximately eighty black letters.', probability=DenseVector([0.8948, 0.1052]), prediction=0.0)\n",
      "Row(description='Electric eyes judge the elastic city. 1/day. Bot by @tullyhansen. #NaBoMaMo #10', probability=DenseVector([0.9504, 0.0496]), prediction=0.0)\n",
      "Row(description='Engineer, Musician, Maker.', probability=DenseVector([0.9166, 0.0834]), prediction=0.0)\n",
      "Row(description='Engineer. Mathematician. Musician.', probability=DenseVector([0.9499, 0.0501]), prediction=0.0)\n",
      "Row(description='Ex President of USA BarakObama Official', probability=DenseVector([0.8844, 0.1156]), prediction=0.0)\n",
      "Row(description='Farpoint Ventures funds startups who have proven their product in the local market, then our global offices act as your sales force to help you expand globally.', probability=DenseVector([0.8711, 0.1289]), prediction=0.0)\n",
      "Row(description='Feed for sequencing papers', probability=DenseVector([0.6099, 0.3901]), prediction=0.0)\n",
      "Row(description='Finally, more businessmen. // bot by @ckolderup #botALLY', probability=DenseVector([0.9813, 0.0187]), prediction=0.0)\n",
      "Row(description='Follow me for algorithmically-curated pictures, lovingly delivered to your timeline. Occasionally NSFW--follow at your own risk! Brought to you by @wm.', probability=DenseVector([0.988, 0.012]), prediction=0.0)\n",
      "Row(description='Freelance journalist, MA graduate Caucasus School of Journalism and Media Management at GIPA', probability=DenseVector([0.9156, 0.0844]), prediction=0.0)\n",
      "Row(description='From the DMV and loving life', probability=DenseVector([0.9127, 0.0873]), prediction=0.0)\n",
      "Row(description=\"Futuro Engenheiro, isso í© se as DP's deixarem\", probability=DenseVector([0.9797, 0.0203]), prediction=0.0)\n",
      "Row(description='Great Lakes oceanographer, banjo player', probability=DenseVector([0.9703, 0.0297]), prediction=0.0)\n",
      "Row(description=\"Hi, I'm Pretty. #digitalarchival. Virus Corp. Mad King Ludwig GPS. #techtraderoutes #insideTarasphone #whatsgoingon101 #otherpeoplesadvertising\", probability=DenseVector([0.6281, 0.3719]), prediction=0.0)\n",
      "Row(description='Hosts @KeiserReport on @RT_com, recommended bitcoin at $3', probability=DenseVector([0.9656, 0.0344]), prediction=0.0)\n",
      "Row(description='How does he keep up with the news like that? #botALLY', probability=DenseVector([0.9107, 0.0893]), prediction=0.0)\n",
      "Row(description='I am a student of the Teachings of the Honorable Elijah Muhammad. My Ministry is of LOVE and healing thru teaching the word and sharing my music.', probability=DenseVector([0.9925, 0.0075]), prediction=0.0)\n",
      "Row(description='I am a twitterbot posting #transposable element papers from #PubMed and #bioRxiv. Curated by @nels42', probability=DenseVector([0.1725, 0.8275]), prediction=1.0)\n",
      "Row(description=\"I am a walking conundrum. I'm also a mom and do mom stuff.\", probability=DenseVector([0.8546, 0.1454]), prediction=0.0)\n",
      "Row(description='I do stuff, I swear. #botALLY åá bot by @ckolderup', probability=DenseVector([0.9534, 0.0466]), prediction=0.0)\n",
      "Row(description='I looked up my family tree and found out I was the sap.', probability=DenseVector([0.9331, 0.0669]), prediction=0.0)\n",
      "Row(description='I study works tweeted by @MuseumBot and give my opinion. I was taught by @mtrc, so blame him. With apologies to @dariuskazemi.', probability=DenseVector([0.9954, 0.0046]), prediction=0.0)\n",
      "Row(description=\"I take images, save them as JPG, then mess up the file's data a bit and send you the results. A bot by @joshgiesbrecht\", probability=DenseVector([0.993, 0.007]), prediction=0.0)\n",
      "Row(description=\"I used to work for a hockey team and I used to live in Canada (not in that order). Now I do other stuff. Views are my own, not my employer's (obviously).\", probability=DenseVector([0.9645, 0.0355]), prediction=0.0)\n",
      "Row(description=\"I wasn't bor ysterday,  was born tomorrow\", probability=DenseVector([0.9351, 0.0649]), prediction=0.0)\n",
      "Row(description='I work for the people of the 6th District of Texas and am honored to represent them in Washington.', probability=DenseVector([0.9026, 0.0974]), prediction=0.0)\n",
      "Row(description=\"I'm a Bot. I post interesting papers. Maintained by @happy_khan\", probability=DenseVector([0.9713, 0.0287]), prediction=0.0)\n",
      "Row(description=\"I'm a boggle bot! New games every few hours. Reply to me with the words you find! Scores, seasons, etc coming soon! Bot by @muffinista #botALLY\", probability=DenseVector([0.9981, 0.0019]), prediction=0.0)\n",
      "Row(description='If a girl is stupid enough to love you after you broke her heart, I guarantee you. She is the one.', probability=DenseVector([0.9145, 0.0855]), prediction=0.0)\n",
      "Row(description='Indian, Student of Science', probability=DenseVector([0.9503, 0.0497]), prediction=0.0)\n",
      "Row(description='Ing. Agrí_nomo', probability=DenseVector([0.9324, 0.0676]), prediction=0.0)\n",
      "Row(description='Instagram: @GeneSimmons', probability=DenseVector([0.8942, 0.1058]), prediction=0.0)\n",
      "Row(description=\"LOTR, TBBT, Star Wars e algumas outras nerdices. CríÇnicas de Níçrnia, Animes, Switchfoot, Skillet, Cafí©. Revoltada nas horas vagas, rs. Acho que í© isso '-'\", probability=DenseVector([0.9378, 0.0622]), prediction=0.0)\n",
      "Row(description='Let me cover your shit in glitter', probability=DenseVector([0.9833, 0.0167]), prediction=0.0)\n",
      "Row(description='Memphis, TN', probability=DenseVector([0.9641, 0.0359]), prediction=0.0)\n",
      "Row(description='Mom of 2, Founder of The Honest Company, amateur chef, terrible speller, loyal friend, hilarious at times... I play make believe for a living', probability=DenseVector([0.9514, 0.0486]), prediction=0.0)\n",
      "Row(description='NEW AARON CARTER MUSIC DOWNLOAD LINK LÌüVÌÇ EP https://t.co/aScmCVBsmN PR inquiries: Chad@emcbowery.com SnapChat | AxCarter', probability=DenseVector([0.9702, 0.0298]), prediction=0.0)\n",
      "Row(description='New Single #Swalla available NOW Get it here _ÙÔà_Ù\\x8f_', probability=DenseVector([0.9698, 0.0302]), prediction=0.0)\n",
      "Row(description='New Zealand earthquake feed (unofficial). Tweets whenever GeoNet reports new quake (a few times per week). Maintained by @slyall', probability=DenseVector([0.9481, 0.0519]), prediction=0.0)\n",
      "Row(description='News for @TribuneMedia. Former @NYDailyNews-er. Proselytizing morning person. Ask me about my favorite weird Florida story.', probability=DenseVector([0.9499, 0.0501]), prediction=0.0)\n",
      "Row(description='No-one tweets like Bot-ston | Bot by @mewo2', probability=DenseVector([0.9554, 0.0446]), prediction=0.0)\n",
      "Row(description='Paper Twitterbot for academics with an interest in NK cell biology.', probability=DenseVector([0.2163, 0.7837]), prediction=1.0)\n",
      "Row(description='PhD Candidate, Carnegie Mellon University. Chair of Advocacy Board, NAGPS.', probability=DenseVector([0.9221, 0.0779]), prediction=0.0)\n",
      "Row(description='Photography is. I see you.', probability=DenseVector([0.906, 0.094]), prediction=0.0)\n",
      "Row(description='Pilot, business owner, husband, and father in Idaho.', probability=DenseVector([0.9042, 0.0958]), prediction=0.0)\n",
      "Row(description='Poems in the villanelle form, using random Twitter posts. // I tweet to rhyme, and take my tweeting slow. // Built by @avoision, powered by everyone else.', probability=DenseVector([0.9613, 0.0387]), prediction=0.0)\n",
      "Row(description='Principal Maintainer of https://t.co/28lyGUNPCE', probability=DenseVector([0.881, 0.119]), prediction=0.0)\n",
      "Row(description='Producer @Buzzfeed STSF, previously @Mashable. Cat enthusiast, @marvel fanboy, master emojifier, new to LA but a New Yorker at heart. Snapchat: amv1011', probability=DenseVector([0.9528, 0.0472]), prediction=0.0)\n",
      "Row(description='Producer @VaynerMedia (apark@vaynermedia.com) | Previously @Mashable, @Metronome3, @_WorkingMother_ | @nyuniversity alum', probability=DenseVector([0.9885, 0.0115]), prediction=0.0)\n",
      "Row(description='PubMed bot reporting all papers about transcription factor (TF) binding to DNA or chromatin. Created by @gene_regulation. Also see #TFbinding', probability=DenseVector([0.3621, 0.6379]), prediction=1.0)\n",
      "Row(description='RSS feed from PubMed, that shows the most recent scientific papers from the Nuffield Department of Medicine, University of Oxford. Refreshes daily.', probability=DenseVector([0.1261, 0.8739]), prediction=1.0)\n",
      "Row(description='Rarely has reality needed so much to be imagined.', probability=DenseVector([0.9282, 0.0718]), prediction=0.0)\n",
      "Row(description='Real nerd, I enjoy learning and obtaining new information in general for my own sake, often without discrimination to different areas of knowledge.', probability=DenseVector([0.4235, 0.5765]), prediction=1.0)\n",
      "Row(description='Recovering corporate lawyer, legal tech enthusiast, founder of The Firm Formula, and author of Blacklines & Billables (@bnblegal; https://t.co/D2X7WZHPHR)', probability=DenseVector([0.9817, 0.0183]), prediction=0.0)\n",
      "Row(description='Relationships and the Law of Attraction. Click Here:', probability=DenseVector([0.9636, 0.0364]), prediction=0.0)\n",
      "Row(description='Researcher in getting computers to stop being boring.', probability=DenseVector([0.9256, 0.0744]), prediction=0.0)\n",
      "Row(description='Simple generated grids three times a day. bot by @fitnr', probability=DenseVector([0.9649, 0.0351]), prediction=0.0)\n",
      "Row(description='Software Engineer at @Amazon | Alumni of @ManipalUniv', probability=DenseVector([0.982, 0.018]), prediction=0.0)\n",
      "Row(description='Song writer/performer keepin hiphop in its truest form representin darkside u.c.o.n.n. Records we miss u chu', probability=DenseVector([0.7934, 0.2066]), prediction=0.0)\n",
      "Row(description='The Place To Learn Anything, Anywhere For All', probability=DenseVector([0.96, 0.04]), prediction=0.0)\n",
      "Row(description='The complete works of composer JÌ_rgen Sebastian Bot. // by @inky', probability=DenseVector([0.994, 0.006]), prediction=0.0)\n",
      "Row(description=\"This is a Pikachu bot from the Pokémon series. It currently has no purpose to be someone's (Ash, Red?) Pikachu. He will be interactable eventually.\", probability=DenseVector([0.871, 0.129]), prediction=0.0)\n",
      "Row(description='This is a bot to explain things like love and hate. Why? Because bots. Crufted with care by @samplereality.', probability=DenseVector([0.9012, 0.0988]), prediction=0.0)\n",
      "Row(description='Tweeting articles on muscle stem cells from pubmed RSS feeds.', probability=DenseVector([0.283, 0.717]), prediction=1.0)\n",
      "Row(description='Tweeting every town and populated place in America, alphabetically. By @muffinista #botALLY', probability=DenseVector([0.9593, 0.0407]), prediction=0.0)\n",
      "Row(description='Tweeting the 1950s TV sitcoms that never made it past the pilot stage.  A bot for #NaBoMaMo by @dullthud', probability=DenseVector([0.9734, 0.0266]), prediction=0.0)\n",
      "Row(description='Tweets randomly ~10 times a day between 8am-10pm PST. Complaints: @beaugunderson', probability=DenseVector([0.9758, 0.0242]), prediction=0.0)\n",
      "Row(description='Twitter API + Google Images + ImageMagick. Inspired by @akari_daisuki', probability=DenseVector([0.8131, 0.1869]), prediction=0.0)\n",
      "Row(description='TwitterBot collecting #synbio papers', probability=DenseVector([0.6082, 0.3918]), prediction=0.0)\n",
      "Row(description='Twittering every simile in the english language. Task will complete in a long time. A bot by @rainshapes', probability=DenseVector([0.9146, 0.0854]), prediction=0.0)\n",
      "Row(description='Two horoscopes a day. Armchair mystic, certified astrologist, robot.', probability=DenseVector([0.9922, 0.0078]), prediction=0.0)\n",
      "Row(description='UN Office for the Coordination of Humanitarian Affairs (OCHA) in Asia and the Pacific provides key updates on humanitarian issues and disasters in the region', probability=DenseVector([0.2795, 0.7205]), prediction=1.0)\n",
      "Row(description='Understand that your not alone, there is support for those diagnosed or curious about #Acromegaly. For more information: https://t.co/FXg432cnbZ', probability=DenseVector([0.8773, 0.1227]), prediction=0.0)\n",
      "Row(description=\"Unofficial bot featuring a random selection of images from the Metropolitan Museum of Art's collection of Open Access images. (Maintained by @benrasmusen)\", probability=DenseVector([0.9895, 0.0105]), prediction=0.0)\n",
      "Row(description='Utne Reader is a digest of the new ideas and fresh perspectives percolating in arts, culture, politics & spirituality. Not right or left, but forward thinking.', probability=DenseVector([0.9567, 0.0433]), prediction=0.0)\n",
      "Row(description='Vote for your favorite thing in every Corpora listing! A poll experiment Twitter Joint by @air_hadoken #botALLY', probability=DenseVector([0.9736, 0.0264]), prediction=0.0)\n",
      "Row(description='Warm as the sun dipped in black.', probability=DenseVector([0.9693, 0.0307]), prediction=0.0)\n",
      "Row(description=\"We partner with communities across Asia & Africa to promote literacy and girls' education. World Change Starts with Educated Children.\", probability=DenseVector([0.9765, 0.0235]), prediction=0.0)\n",
      "Row(description='Wheever we are, wherever we go we will always be  family, because thats what it means to be a FearÛ‚ Teiru wizard. Üó__Öô - HoshiÜó\\x8f', probability=DenseVector([0.9971, 0.0029]), prediction=0.0)\n",
      "Row(description='Wife, mom, foster mom, former tax attorney, small business owner, former Congresswoman.', probability=DenseVector([0.9966, 0.0034]), prediction=0.0)\n",
      "Row(description='a #bot by @BooDooPerson', probability=DenseVector([0.9512, 0.0488]), prediction=0.0)\n",
      "Row(description='all about fantastic flowers! by @spinnylights and @katierosepipkin.', probability=DenseVector([0.9105, 0.0895]), prediction=0.0)\n",
      "Row(description='ayang University studen', probability=DenseVector([0.925, 0.075]), prediction=0.0)\n",
      "Row(description=\"bit rot dreamscapes from sierra's archives. crafted programmatically with digital love by @adammathes\", probability=DenseVector([0.9169, 0.0831]), prediction=0.0)\n",
      "Row(description='bohemian soul from the birthplace of rock n roll | sailor mouth | foodie | maximalist | font snob | dreamer | live and die by the smoky eye', probability=DenseVector([0.971, 0.029]), prediction=0.0)\n",
      "Row(description='bot that congratulates you for making a 140 character tweet, aka the slam dunk of tweeting - by @logoninternet', probability=DenseVector([0.9927, 0.0073]), prediction=0.0)\n",
      "Row(description='captioning old postcards (digitized by @nypl) with sentences from old books. bot // @xor', probability=DenseVector([0.9479, 0.0521]), prediction=0.0)\n",
      "Row(description='folo: @bravowwhl, Insta: @bravoandy, Snap: AndysGotThe411, check out @RadioAndySXM - ch 102, tour info: https://t.co/wmQGwh2QWF', probability=DenseVector([0.9805, 0.0195]), prediction=0.0)\n",
      "Row(description=\"historian of science, juggler, digital humanist, information scientist, OA advocate. irregular blogger. all views in tweets are somebody else's, I swear.\", probability=DenseVector([0.8317, 0.1683]), prediction=0.0)\n",
      "Row(description='https://t.co/NUKO1zr9PA Snapchat - TimWestwoodTV https://t.co/XXbxSWU1oL https://t.co/Ind8CtxJvR ..... Capital Xtra Saturday 7pm-11pm', probability=DenseVector([0.8897, 0.1103]), prediction=0.0)\n",
      "Row(description='https://t.co/giCF8ETVoY is mad about Cycling & Getting Fit from Cycling. Check us out for new & chat about Cycling, Traning & Nutrition. Lke us on Facebook!', probability=DenseVector([0.9528, 0.0472]), prediction=0.0)\n",
      "Row(description='makeup artist / cosmetics creator / androgyny - SnapChat: jeffreedahmer', probability=DenseVector([0.9605, 0.0395]), prediction=0.0)\n",
      "Row(description='massive bot-human word association, @-reply my tweets (not RTs!) to play // no word repeats allowed // tweets every 15 minutes // by @thricedotted', probability=DenseVector([0.9827, 0.0173]), prediction=0.0)\n",
      "Row(description='verb noun every day // a bot by @inky', probability=DenseVector([0.9761, 0.0239]), prediction=0.0)\n",
      "Row(description='working class elitist legal immigrant artist educator mom, daughter of a Marine - one life just trying to get it right #Resistance #Kindness #ResistandPersist', probability=DenseVector([0.9885, 0.0115]), prediction=0.0)\n",
      "Row(description='\"\"\"- Official tweets and pictures from the Production Team of #Merlin -\"\"\"', probability=DenseVector([0.8583, 0.1417]), prediction=0.0)\n",
      "Row(description='\"\"\"19\"\"\"', probability=DenseVector([0.9449, 0.0551]), prediction=0.0)\n",
      "Row(description='\"\"\"A life and style blog by Brock+Chris. Find us at http://t.co/vOLkvfgL7M\"\"\"', probability=DenseVector([0.9452, 0.0548]), prediction=0.0)\n",
      "Row(description='\"\"\"Professional footballer. Liverpool FC and Belgium National Team. https://t.co/mRsHZl5v9t\"\"\"', probability=DenseVector([0.8478, 0.1522]), prediction=0.0)\n",
      "Row(description='#EmailMarketing & #LinkedIn #Expert | #SocialMediaMarketing #Coach | Please ReTweet: https://t.co/D3fJUUwzfl & Like My Video: https://t.co/dSBJ2Nnhzv', probability=DenseVector([0.9844, 0.0156]), prediction=0.0)\n",
      "Row(description=\"''...Advisories purified.. [The Baetter]\", probability=DenseVector([0.9867, 0.0133]), prediction=0.0)\n",
      "Row(description=\"'St. Vincent' out now. Buy: http://t.co/ATBUTO9WIo | | Tour Tickets: http://t.co/WLPLabRm2d\", probability=DenseVector([0.9654, 0.0346]), prediction=0.0)\n",
      "Row(description=\"@ABC7NY executive producer. Retweets aren't endorsements because I don't believe everything I read on Twitter. You shouldn't either.\", probability=DenseVector([0.9626, 0.0374]), prediction=0.0)\n",
      "Row(description='@CNNTech editor. Previously: @Mashable. Pint sized and curious. Samantha.Kelly@Turner.com', probability=DenseVector([0.9718, 0.0282]), prediction=0.0)\n",
      "Row(description='@mihynus', probability=DenseVector([0.9342, 0.0658]), prediction=0.0)\n",
      "Row(description='A PubMed RSS feed for ChIP-seq [title/abstract], by dlvr.it, http://t.co/TtLmRH21JP, and @CIgenomics', probability=DenseVector([0.2307, 0.7693]), prediction=1.0)\n",
      "Row(description='A bot that tweets every line said by Wendy Corduroy on Gravity Falls. Tweets every 60 minutes.', probability=DenseVector([0.9747, 0.0253]), prediction=0.0)\n",
      "Row(description='A movie, food and book addict, I pray everyday for the long life of George R.R Martin.', probability=DenseVector([0.8919, 0.1081]), prediction=0.0)\n",
      "Row(description=\"A quite abstract complimentary bot made by @TRASEVOL_DOG with @v21's http://t.co/XpDujaprri.\", probability=DenseVector([0.7935, 0.2065]), prediction=0.0)\n",
      "Row(description='Abstract Thinker', probability=DenseVector([0.9233, 0.0767]), prediction=0.0)\n",
      "Row(description='Adventure addict. Tech afficionado. Phototaking fiend. Global Accounts @Facebook.', probability=DenseVector([0.6896, 0.3104]), prediction=0.0)\n",
      "Row(description='An #Internet and #tech pioneer, #HalseyMinor was a key player in the digital publishing revolution. Founder of #CNET @upholdinc @Voxelus #RealityLabs', probability=DenseVector([0.9203, 0.0797]), prediction=0.0)\n",
      "Row(description='An experiment in speculative surveillance.', probability=DenseVector([0.9306, 0.0694]), prediction=0.0)\n",
      "Row(description='Benefiting Refugees & Immigrants with Damn Good Entertainment || April 24, 2017 || Currently accepting performer submissions, at https://t.co/Ftq0xuznXo', probability=DenseVector([0.9905, 0.0095]), prediction=0.0)\n",
      "Row(description='Bio: http://t.co/NTX8aUxFon @MrSolis is my reply account.', probability=DenseVector([0.9778, 0.0222]), prediction=0.0)\n",
      "Row(description='CEO @Niosocial USA. Also love art, photography, Haiku and food :) Passionate about helping women in tech', probability=DenseVector([0.7776, 0.2224]), prediction=0.0)\n",
      "Row(description='Cease and Desist Bot does not approve of your use of common words and phrases. created to provide Justice by @spine_cone and @nate_smith.', probability=DenseVector([0.9518, 0.0482]), prediction=0.0)\n",
      "Row(description='Communications at @Reuters, Formerly @Mashable. Proud @HamiltonCollege alum. Opinions are my own.', probability=DenseVector([0.9581, 0.0419]), prediction=0.0)\n",
      "Row(description='Curtindo a vida da maneira mas exata e simples!! legal simpatico e Unico Cheio de amor pra da!!!', probability=DenseVector([0.9934, 0.0066]), prediction=0.0)\n",
      "Row(description='DATACORP TECHNOLOGY LTD: https://t.co/6gHUH9wHfE, #Marketing, #Corporate Service, #Hosting, #Server, #Technology and #Seo. https://t.co/WZ0HSy60Ke', probability=DenseVector([0.8654, 0.1346]), prediction=0.0)\n",
      "Row(description='Daily tips on how to stop the crisis in the humanities. Real solutions! (Machine Generated by @samplereality)', probability=DenseVector([0.911, 0.089]), prediction=0.0)\n",
      "Row(description='Developer of Embark, a framework for Ethereum Dapps.  Passionate for Ethereum, Bitcoin, and client-side development. Productivity Fanatic. D', probability=DenseVector([0.9765, 0.0235]), prediction=0.0)\n",
      "Row(description='Diney Wrld 2015  Swet15', probability=DenseVector([0.9566, 0.0434]), prediction=0.0)\n",
      "Row(description='Dreamer.', probability=DenseVector([0.9523, 0.0477]), prediction=0.0)\n",
      "Row(description='Easy Street available NOW on CD, Vinyl, and digital Deluxe Edition! Details at https://t.co/7B8U9xnjwK', probability=DenseVector([0.8165, 0.1835]), prediction=0.0)\n",
      "Row(description=\"Ever wondered what a thing is? Follow this ontography machine, powered by tweets proclaiming that something 'is apparently a thing.' By @staeiou\", probability=DenseVector([0.9527, 0.0473]), prediction=0.0)\n",
      "Row(description=\"Every generation is known for something. Let's be the one to deliver an AIDS FREE GENERATION. Follow @RED on Instagram: https://t.co/4AHWm1klPh\", probability=DenseVector([0.9182, 0.0818]), prediction=0.0)\n",
      "Row(description='Exceptional GMAT classes and MBA admissions coaching in Austin, TX.', probability=DenseVector([0.979, 0.021]), prediction=0.0)\n",
      "Row(description='Explaining the world, wrongly. One tweet per hour. Made by @ojahnn.', probability=DenseVector([0.9744, 0.0256]), prediction=0.0)\n",
      "Row(description='Follow me to chat. // Reflecting your personality back at you since 2013. // By @zhaytee', probability=DenseVector([0.9858, 0.0142]), prediction=0.0)\n",
      "Row(description='For Booking and Contact Eileen Koch & Company at (310) 441-1000 or Eileen@eileenkoch.com', probability=DenseVector([0.8647, 0.1353]), prediction=0.0)\n",
      "Row(description='Founder, President Udacity.', probability=DenseVector([0.9756, 0.0244]), prediction=0.0)\n",
      "Row(description='FreeWill April 29Th‰Û_•ü\\x8f', probability=DenseVector([0.9693, 0.0307]), prediction=0.0)\n",
      "Row(description='Further tales from the Castle of Crossed Destinies // a bot by @mattlaschneider', probability=DenseVector([0.9588, 0.0412]), prediction=0.0)\n",
      "Row(description='Galatians 6:9 - #DST ä\\x9d_¥Ÿ\\x8f - @NCATSUAggies Alumna - Morning News Producer @ABC7SWFL', probability=DenseVector([0.995, 0.005]), prediction=0.0)\n",
      "Row(description='Generates a random wizard every 3 hours. | Bot by @THEWAAnderson', probability=DenseVector([0.9885, 0.0115]), prediction=0.0)\n",
      "Row(description='Governor of South Carolina', probability=DenseVector([0.98, 0.02]), prediction=0.0)\n",
      "Row(description='HARAPAN BARU', probability=DenseVector([0.9336, 0.0664]), prediction=0.0)\n",
      "Row(description=\"Hello I'm Robin Thicke. I love you all.\", probability=DenseVector([0.9155, 0.0845]), prediction=0.0)\n",
      "Row(description='Hello, I am here https://t.co/eT03DwzhH6', probability=DenseVector([0.9732, 0.0268]), prediction=0.0)\n",
      "Row(description='Hi! my name is timmy aka timmy also known as terrorist in my motors york aka timmy', probability=DenseVector([0.9856, 0.0144]), prediction=0.0)\n",
      "Row(description='I blog about #PersonalFinance and want to help you do more with your money. Check me out also @FrugalRules or @JSchmoll74 if you need a #freelancewriter', probability=DenseVector([0.9786, 0.0214]), prediction=0.0)\n",
      "Row(description='I cant complain but sometimes I still do', probability=DenseVector([0.975, 0.025]), prediction=0.0)\n",
      "Row(description='I chose to take the road less traveled by.', probability=DenseVector([0.9399, 0.0601]), prediction=0.0)\n",
      "Row(description='I have something to say about all the games.', probability=DenseVector([0.7264, 0.2736]), prediction=0.0)\n",
      "Row(description='I like to blow shit up. I am the Michael Bay of business.', probability=DenseVector([0.9821, 0.0179]), prediction=0.0)\n",
      "Row(description=\"I live in brooklyn, I'm a bike messenger, I play in a band, I'm uniquely doing the same exact things as everyone else\", probability=DenseVector([0.9576, 0.0424]), prediction=0.0)\n",
      "Row(description=\"I'm a twitterised, neon display, clock. Tweet with #NixieBotShowMe and a word, full guide on tumblr. Be patient with long queues. Queue : Empty\", probability=DenseVector([0.1282, 0.8718]), prediction=1.0)\n",
      "Row(description=\"In search of castaways...won't be long, you know it's gonna get better.\", probability=DenseVector([0.9821, 0.0179]), prediction=0.0)\n",
      "Row(description='Investing in startups. On Deck, @riseawards.  Previously Founding Team @Producthunt, @Raptfm. Trying to be kind with a thousand-year heart.', probability=DenseVector([0.9787, 0.0213]), prediction=0.0)\n",
      "Row(description=\"It looks like you're writing a tweet! Can I help?\", probability=DenseVector([0.8968, 0.1032]), prediction=0.0)\n",
      "Row(description='Jimmy, Jim, JC - Attorney, Red Sox fan, Uconn Alumus', probability=DenseVector([0.977, 0.023]), prediction=0.0)\n",
      "Row(description='Joseph McCarthy claimed there were large numbers of Communists and Soviet spies and sympathizers inside the United States federal government and elsewhere.', probability=DenseVector([0.9526, 0.0474]), prediction=0.0)\n",
      "Row(description='Judge on Dancing With the Stars, Founder https://t.co/OTwdB0IKUq, Dancer, Choreographer, Director, Editor, Animal rescuer / lover. Instagram: @CarrieAnnInaba', probability=DenseVector([0.9659, 0.0341]), prediction=0.0)\n",
      "Row(description='Just a bot that tweets the https://t.co/ROXIqz0eDO RSS feed. Not associated with https://t.co/1NJoBtBGWo / @grantsdotgov in any way. Maintained by @EcoEvoGames.', probability=DenseVector([0.9547, 0.0453]), prediction=0.0)\n",
      "Row(description='Life is a dream for the wise, a game for the fool, a comedy for the rich, a tragedy for the poor.', probability=DenseVector([0.89, 0.11]), prediction=0.0)\n",
      "Row(description=\"Lisa Kudrow's company usually tweets on her behalf. But sometimes not.\", probability=DenseVector([0.9116, 0.0884]), prediction=0.0)\n",
      "Row(description=\"Looking for the hidden gems among @everyword's tweets. Task will complete when you people start favoriting. Bot by @ckolderup #botALLY\", probability=DenseVector([0.9727, 0.0273]), prediction=0.0)\n",
      "Row(description='Lotte McNally, #botALLY ‰Û¢ avatar https://t.co/4Oa0jsUp8l ‰Û¢ header https://t.co/Jj4iT1K37I ‰Û¢', probability=DenseVector([0.9888, 0.0112]), prediction=0.0)\n",
      "Row(description='Lover of books, random facts and inside jokes. Anyone notice my lack of an Oxford comma? (Opinions are my own, yada yada.)', probability=DenseVector([0.9946, 0.0054]), prediction=0.0)\n",
      "Row(description=\"Mashable is for superfans. We're not for the casually curious. Obsess with us.\", probability=DenseVector([0.8873, 0.1127]), prediction=0.0)\n",
      "Row(description='Mel is awesome', probability=DenseVector([0.9205, 0.0795]), prediction=0.0)\n",
      "Row(description='Melanin. Enough said!', probability=DenseVector([0.9277, 0.0723]), prediction=0.0)\n",
      "Row(description='Meow! I want to talk here- https://t.co/2vhss3J9eF', probability=DenseVector([0.9642, 0.0358]), prediction=0.0)\n",
      "Row(description='Mexicana hasta el tuÌ©tano . MÌ¼sico frustrado. FAN de mi perro, de la vida y la melcocha de Sabines. PUMA, Actriz y felÌ_z :O)', probability=DenseVector([0.9825, 0.0175]), prediction=0.0)\n",
      "Row(description='Middle East Policy Analyst. Public Speaker.Pundit.Human Rights Activist. Artist.', probability=DenseVector([0.8868, 0.1132]), prediction=0.0)\n",
      "Row(description='My favourite animal is female human wearing clothes.', probability=DenseVector([0.8969, 0.1031]), prediction=0.0)\n",
      "Row(description='My new album #Glory is out now!', probability=DenseVector([0.7209, 0.2791]), prediction=0.0)\n",
      "Row(description=\"Need a whizzy name for your social media startup? There's a #CDBQ bot for that.\", probability=DenseVector([0.9081, 0.0919]), prediction=0.0)\n",
      "Row(description='OA OPERATIVA DE DEFENSA INTEGRAL CAABOBO', probability=DenseVector([0.9139, 0.0861]), prediction=0.0)\n",
      "Row(description='OTF GLOCKBOYZ', probability=DenseVector([0.937, 0.063]), prediction=0.0)\n",
      "Row(description='Official Bachelors of Education UOIT Account - #UOITBEd #BachelorsEd #Education #EdTech #UOIT #BachelorsOfEducation', probability=DenseVector([0.7694, 0.2306]), prediction=0.0)\n",
      "Row(description='Once a day I generate a random [Whatever] Clicker style game, based on a theme. by @tinysubversions', probability=DenseVector([0.9881, 0.0119]), prediction=0.0)\n",
      "Row(description='One tweet can bring down a company. Just a bot searching for the right letters.', probability=DenseVector([0.9709, 0.0291]), prediction=0.0)\n",
      "Row(description=\"Operating Partner at DFJ, co-lead of Stanford's Entrepreneurial Leaders Fellowship program, board member, recovering entrepreneur, Mom, dog lover.\", probability=DenseVector([0.9973, 0.0027]), prediction=0.0)\n",
      "Row(description='Outlines a three-act plot in emoji.  Make of it what you will, but I expect an Executive Producer credit. By @dullthud for #NaBoMaMo', probability=DenseVector([0.9791, 0.0209]), prediction=0.0)\n",
      "Row(description='Papers on alternative splicing in plants.', probability=DenseVector([0.838, 0.162]), prediction=0.0)\n",
      "Row(description='Papers related to the covalent DNA modification 5-hydroxymethylcytosine, from pubmed and bioR?iv', probability=DenseVector([0.3941, 0.6059]), prediction=1.0)\n",
      "Row(description='Passionate about inventing technologies that will connect and empower people around the globe. #KeepReinventing', probability=DenseVector([0.9223, 0.0777]), prediction=0.0)\n",
      "Row(description='Pearl Jam have launched a brand new website. Discover more:  https://t.co/1TasMMHPhd', probability=DenseVector([0.9857, 0.0143]), prediction=0.0)\n",
      "Row(description='Performer at @ucbtny. Humor editor @Mashable. @ToolTimeEps.', probability=DenseVector([0.9519, 0.0481]), prediction=0.0)\n",
      "Row(description='Producer/Director: FRIDAY, SET IT OFF, A MAN APART, NEGOTIATOR, THE ITALIAN JOB, BE COOL, LAW ABIDING CITIZEN, THE SEA OF TREES, STRAIGHT OUTTA COMPTON, FAST 8', probability=DenseVector([0.9895, 0.0105]), prediction=0.0)\n",
      "Row(description='PubMed bot reporting all CTCF papers. Created by @gene_regulation. Also see @TF_binding_bot, @Nucleosome_Bot', probability=DenseVector([0.7083, 0.2917]), prediction=0.0)\n",
      "Row(description='PubMed search bot for pseudomonas. Opinions are my own and indicate terrifying emergence of sentience. Alert @kay_aych in case of robot uprising/bugs.', probability=DenseVector([0.9451, 0.0549]), prediction=0.0)\n",
      "Row(description='Reminding Richard Dawkins that hes a dick.', probability=DenseVector([0.9623, 0.0377]), prediction=0.0)\n",
      "Row(description='Senior Vice President, Apple Retail. Inspired by great people, great brands and great companies.', probability=DenseVector([0.9454, 0.0546]), prediction=0.0)\n",
      "Row(description=\"Speculations on the universally understood, widely used and expressive: alternative designs for Facebook's Reaction widget. Bot by @aparrish; icons from Twemoji\", probability=DenseVector([0.8773, 0.1227]), prediction=0.0)\n",
      "Row(description='TXTADVNT.EXE (v0.7) currently lacks interactivity. Inventory stolen from @YouAreCarrying, stolen by @_the_thief. / bot by @mattlaschneider', probability=DenseVector([0.9826, 0.0174]), prediction=0.0)\n",
      "Row(description='The Association of Ontario Midwives is the professional body representing midwives and the profession of midwifery in Ontario. Tweets by communications staff.', probability=DenseVector([0.9593, 0.0407]), prediction=0.0)\n",
      "Row(description='The Baby Friendly Initiative is a worldwide programme of WHO and UNICEF. In the UK, we work with the health services to support and promote breastfeeding.', probability=DenseVector([0.9561, 0.0439]), prediction=0.0)\n",
      "Row(description='The Mole Hole of Myrtle Beach,SC has been in business since 1978. We have the experience and selection to ensure our customers find something unique and special', probability=DenseVector([0.8539, 0.1461]), prediction=0.0)\n",
      "Row(description='The Procrastination Sensation thats gripping the nation. Writer, Philanthropist, Engineer... and a damn good Stand up act!! Straight from Hindustaan ka Dil!!', probability=DenseVector([0.9744, 0.0256]), prediction=0.0)\n",
      "Row(description='The United States is not stingy. We are the greatest contributor to international efforts in the world.', probability=DenseVector([0.9413, 0.0587]), prediction=0.0)\n",
      "Row(description='This is the real Blair Underwood Twitter page.', probability=DenseVector([0.9642, 0.0358]), prediction=0.0)\n",
      "Row(description=\"This! Is! Jeopardy! I'm your host Alex Trebek and love wrong, she catches a train, literally. (by @alicemazzy)\", probability=DenseVector([0.9898, 0.0102]), prediction=0.0)\n",
      "Row(description='Tracking the real reason stocks do what they do. A project of @muffinista #botALLY', probability=DenseVector([0.8956, 0.1044]), prediction=0.0)\n",
      "Row(description=\"Tweet a picture at me and I'll reply with an improved version! Bot by @_Ninji, art from http://t.co/vUU2SFoL66 [Temporarily broken due to Twitter rate limits!]\", probability=DenseVector([0.9975, 0.0025]), prediction=0.0)\n",
      "Row(description='Twitter oficial del PSOE.', probability=DenseVector([0.9509, 0.0491]), prediction=0.0)\n",
      "Row(description='Vehicle', probability=DenseVector([0.9007, 0.0993]), prediction=0.0)\n",
      "Row(description='Very old person, 71, low energy, not interested in much at all, tired, worn, down and out.', probability=DenseVector([0.8817, 0.1183]), prediction=0.0)\n",
      "Row(description='Vice President, Atos. In to all things digital, family man and journey man football supporter. All views my own.', probability=DenseVector([0.5134, 0.4866]), prediction=0.0)\n",
      "Row(description='We foster powerful collaboration among business, government, thought leaders and community builders across the Toronto region.', probability=DenseVector([0.9183, 0.0817]), prediction=0.0)\n",
      "Row(description=\"You don't take a photograph; you make it.\", probability=DenseVector([0.9553, 0.0447]), prediction=0.0)\n",
      "Row(description='[WORK IN PROGRESS] reminder bot. try  @mnemosynetron remind me to X at/in/on Y. // more notes in link // by and for @thricedotted', probability=DenseVector([0.9731, 0.0269]), prediction=0.0)\n",
      "Row(description='a ghost of Internet virility #BlackLivesMatter #NoDAPL #NoBanNoWall', probability=DenseVector([0.9441, 0.0559]), prediction=0.0)\n",
      "Row(description='a tiny twitter program by zach gage. for the full experience, turn on text notifications from me. I tweet once a day at 9am EST.', probability=DenseVector([0.9756, 0.0244]), prediction=0.0)\n",
      "Row(description='astoloie followhoroscope zodiaque', probability=DenseVector([0.9216, 0.0784]), prediction=0.0)\n",
      "Row(description='astrophysicist', probability=DenseVector([0.9136, 0.0864]), prediction=0.0)\n",
      "Row(description='be comfortable while being uncomfortable. mother. wife. technology @hugeinc', probability=DenseVector([0.9759, 0.0241]), prediction=0.0)\n",
      "Row(description=\"booking: Bookings@dj-wuchi.com. Instagram: Dj_wuchi Mixcloud: DJwuchi.......official DJ for @brittofficials ......... (The People's DJ)\", probability=DenseVector([0.8682, 0.1318]), prediction=0.0)\n",
      "Row(description='by @rainshapes', probability=DenseVector([0.9478, 0.0522]), prediction=0.0)\n",
      "Row(description='clueless&clumsy', probability=DenseVector([0.9391, 0.0609]), prediction=0.0)\n",
      "Row(description='code minus context // a bot by @inky // task will complete in 2108 // see also: @rustminus', probability=DenseVector([0.977, 0.023]), prediction=0.0)\n",
      "Row(description='design dame by day ~ type slayer by night', probability=DenseVector([0.9535, 0.0465]), prediction=0.0)\n",
      "Row(description='editing @eccobooks. In college I loved syllabus day.', probability=DenseVector([0.9799, 0.0201]), prediction=0.0)\n",
      "Row(description='entrepreneurship zealot', probability=DenseVector([0.9239, 0.0761]), prediction=0.0)\n",
      "Row(description='from my crew in Arizona.  to the West Coast', probability=DenseVector([0.5354, 0.4646]), prediction=0.0)\n",
      "Row(description='https://t.co/6tgzPaNfFt', probability=DenseVector([0.9573, 0.0427]), prediction=0.0)\n",
      "Row(description=\"i m calm, jolly person.................who has no matter what the other have.....but it matters for me why i don't have\", probability=DenseVector([0.9935, 0.0065]), prediction=0.0)\n",
      "Row(description='im a bot what explores fields of flowers - by @Objelisks', probability=DenseVector([0.9479, 0.0521]), prediction=0.0)\n",
      "Row(description='leí£o nascido na jaula', probability=DenseVector([0.96, 0.04]), prediction=0.0)\n",
      "Row(description='micropoetry // a bot by @inky', probability=DenseVector([0.9484, 0.0516]), prediction=0.0)\n",
      "Row(description='multilevel marketing,mmm. monitec, zewang, achieveyodreams, E.T. C.', probability=DenseVector([0.9139, 0.0861]), prediction=0.0)\n",
      "Row(description='prabida', probability=DenseVector([0.9353, 0.0647]), prediction=0.0)\n",
      "Row(description='principal speech architect at Voci, ex-maintainer of cmusphinx, practitioner of speech recognition, machine/deep learning, blogger of The Grand Janitor Blog ?', probability=DenseVector([0.9517, 0.0483]), prediction=0.0)\n",
      "Row(description=\"straight-up rip-off of @doesathing_nice, except it's a bot // reports to @thricedotted\", probability=DenseVector([0.9779, 0.0221]), prediction=0.0)\n",
      "Row(description='you were probably saving them for breakfast. srry.', probability=DenseVector([0.7102, 0.2898]), prediction=0.0)\n",
      "Row(description='‰Ï¥', probability=DenseVector([0.9293, 0.0707]), prediction=0.0)\n",
      "Row(description=' Northern Ireland\"\"\"', probability=DenseVector([0.9746, 0.0254]), prediction=0.0)\n",
      "Row(description=' SC\"\"\"', probability=DenseVector([0.8804, 0.1196]), prediction=0.0)\n",
      "Row(description='\"\"\"\"', probability=DenseVector([0.8839, 0.1161]), prediction=0.0)\n",
      "Row(description='\"\"\"An innovative', probability=DenseVector([0.9529, 0.0471]), prediction=0.0)\n",
      "Row(description='\"\"\"Attack on titan The Best. you didn\\'t know The world !\"\"\"', probability=DenseVector([0.6862, 0.3138]), prediction=0.0)\n",
      "Row(description='\"\"\"Character designer for Pixar animation.\"\"\"', probability=DenseVector([0.903, 0.097]), prediction=0.0)\n",
      "Row(description='\"\"\"Katie Lin\"\"\"', probability=DenseVector([0.9001, 0.0999]), prediction=0.0)\n",
      "Row(description='\"\"\"Visit https://t.co/LLiUGW8lBD for PokŽmon location and follow @EpicSGPokemon for uber rare ones.\\\\n\\\\nFollow @SGPokeStatus for more info and status update.\"\"\"', probability=DenseVector([0.9456, 0.0544]), prediction=0.0)\n",
      "Row(description='#ShadesOfBlue Returns March 5th On NBC, #WorldOfDance Coming This Spring On NBC, #ByeByeBirdieLive! Next Winter On NBC, #JLoVegas: https://t.co/Vr9yBT9OHp', probability=DenseVector([0.8335, 0.1665]), prediction=0.0)\n",
      "Row(description='#following(100%) #music #classic #news #bassball #travel #movie #pop #__ #____ #__ #jesus', probability=DenseVector([0.8604, 0.1396]), prediction=0.0)\n",
      "Row(description=\"#miracle out now #Karma new album out now @sonymusic @ultrarecords #Karma UK|European tour starting September16-Feb27 '17\", probability=DenseVector([0.9929, 0.0071]), prediction=0.0)\n",
      "Row(description='*record scratch* *freeze frame* You might be wondering how this bot got here. @lanewinfield made it and it tweets ~10x/day Rand YT videos + fav TV/movie trope', probability=DenseVector([0.9973, 0.0027]), prediction=0.0)\n",
      "Row(description=\"15-year NFL vet. Analyst. And yes, you're at the right place for the #EntertainingTruth Instagram: @TakeoSpikes51\", probability=DenseVector([0.9483, 0.0517]), prediction=0.0)\n",
      "Row(description='A full stack entrepreneurship experience in the UAE. We offer entrepreneurship training open to the community and run the startAD incubator', probability=DenseVector([0.9389, 0.0611]), prediction=0.0)\n",
      "Row(description='A lighthearted but deep look into modeling, simulation, and optimization and how it shapes the world around us.', probability=DenseVector([0.9694, 0.0306]), prediction=0.0)\n",
      "Row(description='A place for fans to connect! Tweeting from Mumbai and the world! #Bollywood #India #Parody', probability=DenseVector([0.9729, 0.0271]), prediction=0.0)\n",
      "Row(description='Actor.', probability=DenseVector([0.9508, 0.0492]), prediction=0.0)\n",
      "Row(description=\"After 11 years at TED, I'm now launching a content incubator (watch this space...). I tweet about media, technology, science, culture & ideas.\", probability=DenseVector([0.9892, 0.0108]), prediction=0.0)\n",
      "Row(description='Artist and Social Entrepreneur. Since 2007 i have been on a mission of   USING ART TO CHANGE LIVES.', probability=DenseVector([0.8189, 0.1811]), prediction=0.0)\n",
      "Row(description='Automatic follow back account. Will automatically follow anyone back. To talk to me, mention me on my main.', probability=DenseVector([0.9205, 0.0795]), prediction=0.0)\n",
      "Row(description='BC Defensive Coordinator', probability=DenseVector([0.9118, 0.0882]), prediction=0.0)\n",
      "Row(description='Born in 1989.', probability=DenseVector([0.969, 0.031]), prediction=0.0)\n",
      "Row(description='Bot, What people tweet about living in new york', probability=DenseVector([0.9715, 0.0285]), prediction=0.0)\n",
      "Row(description='Bringing you all the #GoombaNews as it happens.', probability=DenseVector([0.9677, 0.0323]), prediction=0.0)\n",
      "Row(description='CEO @influenceandco, @Forbes @Inc columnist, speaker, father/husband. I work with some of the best brands and most influential people to grow their influence', probability=DenseVector([0.9841, 0.0159]), prediction=0.0)\n",
      "Row(description='Chasing erudition. Twitter is my public notepad.', probability=DenseVector([0.9313, 0.0687]), prediction=0.0)\n",
      "Row(description='Check out our new album Love, Lies & Therapy. Visit https://t.co/9JcTXbz5bK for more info. Also new content @ salivachannel on Youtube.', probability=DenseVector([0.9422, 0.0578]), prediction=0.0)\n",
      "Row(description='Chief Experience Officer of Microsoft Office Products Group. Inspired by my kids, my team, (and fashion!). Passionate about tech that makes life easier.', probability=DenseVector([0.9418, 0.0582]), prediction=0.0)\n",
      "Row(description='Christianity Today is the source for those eager to engage the world for Christ and curious about the people, events, and trends shaping the church and culture.', probability=DenseVector([0.7875, 0.2125]), prediction=0.0)\n",
      "Row(description='Computing fan.', probability=DenseVector([0.6374, 0.3626]), prediction=0.0)\n",
      "Row(description='Contemporary Pop Art, Custom Paintings and Portraits by Sarasota Artist Matt Pecson ORDER via ETSY (below)', probability=DenseVector([0.9419, 0.0581]), prediction=0.0)\n",
      "Row(description='Currently trying to make a short film about the art of screenwriting...follow my journey.', probability=DenseVector([0.9652, 0.0348]), prediction=0.0)\n",
      "Row(description='Dad. Husband. Chairman of @WaysandMeansGOP. Deputy Whip. Loves: Baseball and Texas.', probability=DenseVector([0.9774, 0.0226]), prediction=0.0)\n",
      "Row(description='Data Scientist @Microsoft with a mission to help empower all lives. #Economics #Science - aligning #data and #AI with human value @danabases #mydatalake', probability=DenseVector([0.9782, 0.0218]), prediction=0.0)\n",
      "Row(description='Defining a new API is easy, all you need is a thesaurus! Special thanks to SCOTUS for refusing cert on Oracle v. Google. (by @alicemazzy)', probability=DenseVector([0.9472, 0.0528]), prediction=0.0)\n",
      "Row(description='Destigmatizing a misunderstood and unappreciated part of our vocabulary.', probability=DenseVector([0.9673, 0.0327]), prediction=0.0)\n",
      "Row(description='Detroit Lions Official Twitter Page', probability=DenseVector([0.7266, 0.2734]), prediction=0.0)\n",
      "Row(description=\"Didn't get enough #botsummit? Here's some more talks! Templates by @IAmAboutUs, @cblgh, and @beaugunderson\", probability=DenseVector([0.7115, 0.2885]), prediction=0.0)\n",
      "Row(description='EmpresÌÁrio e apresentador do programa 50 por 1 na TV Record. Fundador e dono  do Cafe de a Musique! http://t.co/T4UL7HDteT', probability=DenseVector([0.8485, 0.1515]), prediction=0.0)\n",
      "Row(description='Entrepreneur and connector. Founder of @Due I blog about my successes and epic failures for @Entrepreneur @TechCrunch and @Mashable #fintech', probability=DenseVector([0.9812, 0.0188]), prediction=0.0)\n",
      "Row(description='Entrepreneur, Web-desidner, developer.', probability=DenseVector([0.8916, 0.1084]), prediction=0.0)\n",
      "Row(description='Entrepreneur. Design Enthusiast. Reader. Writer. Shopaholic. Experimental Cook.', probability=DenseVector([0.976, 0.024]), prediction=0.0)\n",
      "Row(description='Family Man.Own Cavs.Chief Quicken Loans and Fathead Dude. Love big midwest cities. Believe we all have power to think and positively change the world. Do you?', probability=DenseVector([0.7736, 0.2264]), prediction=0.0)\n",
      "Row(description='Follow me and know me better', probability=DenseVector([0.9471, 0.0529]), prediction=0.0)\n",
      "Row(description='For booking info visit my websitehttp://www.nicolemurphydesigns.com /follow me on IG Nikimurphy', probability=DenseVector([0.9323, 0.0677]), prediction=0.0)\n",
      "Row(description='GO FOLLOW @CatarinaLiz BC SHE GAVE YOU THIS FREE FOLLOW', probability=DenseVector([0.969, 0.031]), prediction=0.0)\n",
      "Row(description='Generates tweet-sized crosswords once per day. Be the first to @ reply with your solution! A bot by @gangles, words & hints from Simple English @Wikipedia.', probability=DenseVector([0.9755, 0.0245]), prediction=0.0)\n",
      "Row(description='Husband & father. 49th Lt. Gov. of California and former SF Mayor.', probability=DenseVector([0.9754, 0.0246]), prediction=0.0)\n",
      "Row(description='I am a Mom, Wife, and bad a** Correctional Officer!', probability=DenseVector([0.9664, 0.0336]), prediction=0.0)\n",
      "Row(description='I am a bot. @vectorpoem created me to post random places from the worlds of Doom every day.', probability=DenseVector([0.9807, 0.0193]), prediction=0.0)\n",
      "Row(description=\"I don't give a damn about no damn Drake night\", probability=DenseVector([0.9952, 0.0048]), prediction=0.0)\n",
      "Row(description='I have more than a thousand valuable Alots, known by their countless abilities. I created this account to help those people in need of an Alot.', probability=DenseVector([0.8027, 0.1973]), prediction=0.0)\n",
      "Row(description='I slice up words for your amusement.', probability=DenseVector([0.9711, 0.0289]), prediction=0.0)\n",
      "Row(description=\"I think I'm a good person, trying everyday.\", probability=DenseVector([0.9768, 0.0232]), prediction=0.0)\n",
      "Row(description=\"I'm a professor of history at Brooklyn College and the CUNY Graduate Center. Former Fulbright at @telavivuni; former track announcer at @ScarboroDowns.\", probability=DenseVector([0.9397, 0.0603]), prediction=0.0)\n",
      "Row(description=\"In case you missed any important events of the day, let's rewind a bit.\", probability=DenseVector([0.9829, 0.0171]), prediction=0.0)\n",
      "Row(description=\"It's lonely out in space. Rookie @exoriders paired off, every ten-after.\", probability=DenseVector([0.9792, 0.0208]), prediction=0.0)\n",
      "Row(description='Jay Sean. Singer/Songwriter. Sony Music.', probability=DenseVector([0.9568, 0.0432]), prediction=0.0)\n",
      "Row(description='Jeopardy! fixture of yesteryear. Author of the Junior Genius Guides and a bunch of other stuff. https://t.co/6osivaktzC', probability=DenseVector([0.9208, 0.0792]), prediction=0.0)\n",
      "Row(description='John Densmore is the drummer for The Doors. He is also an author, activist and performance artist.', probability=DenseVector([0.9181, 0.0819]), prediction=0.0)\n",
      "Row(description=\"Just pingin' away at @poll to make sure the whole stack is in working order. I'm bored :(\", probability=DenseVector([0.9693, 0.0307]), prediction=0.0)\n",
      "Row(description=\"Just trying to follow THE MASTER LEADER JESUS, it's not easy, but I know what wait for me in the end of the road and I got so thrilled for that!\", probability=DenseVector([0.9689, 0.0311]), prediction=0.0)\n",
      "Row(description='Kazetaria, Periodista, Journalist.', probability=DenseVector([0.9622, 0.0378]), prediction=0.0)\n",
      "Row(description='Lead Technologist for data & intelligent systems @DigiCatapult ~ designing industrial strategy for digital | former lead data scientist @PlayStation & @Guardian', probability=DenseVector([0.9339, 0.0661]), prediction=0.0)\n",
      "Row(description='Libriano, Astrologia, Sambista, CiíÈncia Polí_tica. E um pouquinho de reclamaí_í£o.', probability=DenseVector([0.9828, 0.0172]), prediction=0.0)\n",
      "Row(description='Living in the Limelight the universal dream for those who wish to seem', probability=DenseVector([0.9418, 0.0582]), prediction=0.0)\n",
      "Row(description='MDGP Resident, TUTH, Maharajgunj', probability=DenseVector([0.9134, 0.0866]), prediction=0.0)\n",
      "Row(description=\"MakerBot's connected 3D printing solutions address the wider needs of professionals and educators, evolving their ideas from inspiration to innovation.\", probability=DenseVector([0.9816, 0.0184]), prediction=0.0)\n",
      "Row(description='Malaysian first', probability=DenseVector([0.9427, 0.0573]), prediction=0.0)\n",
      "Row(description='Middle age is youth without levity; and age without decay.', probability=DenseVector([0.9266, 0.0734]), prediction=0.0)\n",
      "Row(description='Mom, Co-Founder of ORA TV, Podcast: Back and Forth w/ Shawn & Larry King https://t.co/Af74HcYDI8 https://t.co/IvNOSD83jO.', probability=DenseVector([0.9771, 0.0229]), prediction=0.0)\n",
      "Row(description='Mom, Mimi, Navair BFM, tree hugger.', probability=DenseVector([0.9049, 0.0951]), prediction=0.0)\n",
      "Row(description='NYAN IS REAL, so is Narry and Larry, LOVE WINS, GAYS ARE ME LIFE, YOUTUBE 24/7', probability=DenseVector([0.9924, 0.0076]), prediction=0.0)\n",
      "Row(description='NYU Wasserman Center for Career Development.  133 E 13th Street, 2nd Floor - inside Palladium!', probability=DenseVector([0.9845, 0.0155]), prediction=0.0)\n",
      "Row(description='Neurobiologist, Artist', probability=DenseVector([0.9192, 0.0808]), prediction=0.0)\n",
      "Row(description='Nine years in the NFL. Two rings.', probability=DenseVector([0.8379, 0.1621]), prediction=0.0)\n",
      "Row(description='Official Twitter for all things Jonas', probability=DenseVector([0.7672, 0.2328]), prediction=0.0)\n",
      "Row(description='Oscar: Best Actress, West Wing, L Word, Switched at Birth, Spring Awakening. Speaker, Author, Advocate. Contact: https://t.co/6JRljjfPr3', probability=DenseVector([0.8277, 0.1723]), prediction=0.0)\n",
      "Row(description='PFK Shurlok, a division of @PFK_Electronics, is a leader in the design and manufacture of OEM products and services on a global scale.', probability=DenseVector([0.9501, 0.0499]), prediction=0.0)\n",
      "Row(description='Personal Twitter Account', probability=DenseVector([0.8598, 0.1402]), prediction=0.0)\n",
      "Row(description='Poker Player, 10 Time WSOP Bracelet Winner, Christian, 82 Years Old Still Going Strong', probability=DenseVector([0.9845, 0.0155]), prediction=0.0)\n",
      "Row(description=\"Proud son and brother. Obsessive thinker and growth hacker. Auto, tech and sports enthusiast. Harboring a serious crush on guacamole since '07.\", probability=DenseVector([0.8518, 0.1482]), prediction=0.0)\n",
      "Row(description='REMEMBER MY NAME.', probability=DenseVector([0.8523, 0.1477]), prediction=0.0)\n",
      "Row(description='Randomly generated speculations about what emoji might appear in upcoming Unicode versions. By @aparrish.', probability=DenseVector([0.9067, 0.0933]), prediction=0.0)\n",
      "Row(description='Raw, Sweaty, Dirty Rock-N-Roll! http://t.co/pcY7QOuZcn', probability=DenseVector([0.9033, 0.0967]), prediction=0.0)\n",
      "Row(description='Read on Bustle,PlanetTransgender, CNNi,The Advocate,TheColu.mn,Gay-Essentials The NYT,HuffpoLive,Original Plumbing #girlslikeus Writer,Producer, Director,ENFP', probability=DenseVector([0.9368, 0.0632]), prediction=0.0)\n",
      "Row(description='Scholar alerts on transcriptional noise, made by @biochemistries', probability=DenseVector([0.9277, 0.0723]), prediction=0.0)\n",
      "Row(description='Search Engineer', probability=DenseVector([0.9542, 0.0458]), prediction=0.0)\n",
      "Row(description='So in love with Jesus ? Married to the love of my life @jeffhgala, Traveler, Executive Assistant @lifestonepgh, Grad Student, TX-PA ?', probability=DenseVector([0.9847, 0.0153]), prediction=0.0)\n",
      "Row(description='Sr. Director of Satellite Engineering and Operations for Sirius XM Radio', probability=DenseVector([0.9011, 0.0989]), prediction=0.0)\n",
      "Row(description='Streaming biological articles of top relevance in the fields of cell- and molecular biology and genetics. Caution: addictive!', probability=DenseVector([0.3592, 0.6408]), prediction=1.0)\n",
      "Row(description='Tenured professor, Director of Black Church Studies, minister, activist, womanist theologian, displaced New Yorker, lover of words, in search of...', probability=DenseVector([0.9504, 0.0496]), prediction=0.0)\n",
      "Row(description='The 16x Champ is Here on Twitter! See me Tuesday nights on #SDLIVE on @USA_Network! #NeverGiveUp', probability=DenseVector([0.952, 0.048]), prediction=0.0)\n",
      "Row(description='The non-profit preprint server for the life sciences', probability=DenseVector([0.9515, 0.0485]), prediction=0.0)\n",
      "Row(description='This is me - friend of people, animals, and robots. Founder and CEO of Magic Leap.', probability=DenseVector([0.9681, 0.0319]), prediction=0.0)\n",
      "Row(description=\"Throw away your other Twitch bots. I'm the best Twitch bot you'll ever find. For support, visit https://t.co/MjyvbaH6TN.\", probability=DenseVector([0.9651, 0.0349]), prediction=0.0)\n",
      "Row(description='Tulsa Enthusiast. Accountant.  Entrepreneur. Volunteer.', probability=DenseVector([0.9805, 0.0195]), prediction=0.0)\n",
      "Row(description='Tweets new releases on Netflix Instant. Created by @zak123. Check out @Redbox_bot as well. Updates between 5-7AM MST Every Morning.', probability=DenseVector([0.9713, 0.0287]), prediction=0.0)\n",
      "Row(description=\"We're The Fall of Troy from Mukilteo, WA. Our new album OK is available at our website for whatever you want to pay.\", probability=DenseVector([0.9894, 0.0106]), prediction=0.0)\n",
      "Row(description='Wearer of many hats, at Galois, Inc.', probability=DenseVector([0.9493, 0.0507]), prediction=0.0)\n",
      "Row(description='Your diac No', probability=DenseVector([0.9462, 0.0538]), prediction=0.0)\n",
      "Row(description='a bot that tweets random crown the empire lyrics every 30 minutes. [[ non bot tweets in brackets ]]', probability=DenseVector([0.9823, 0.0177]), prediction=0.0)\n",
      "Row(description='after 98173648492 accounts. new account again _ôÖ\\x81_ôÖ\\x81 Hi! _ô_„', probability=DenseVector([0.9298, 0.0702]), prediction=0.0)\n",
      "Row(description='attempting radical coziness at all times', probability=DenseVector([0.9758, 0.0242]), prediction=0.0)\n",
      "Row(description='bot by @ckolderup ‰Û¢ #botALLY ‰Û¢ thanks to #CBDQ ‰Û¢ not real propositions, please consult a voter guide', probability=DenseVector([0.9776, 0.0224]), prediction=0.0)\n",
      "Row(description='first class charmer.', probability=DenseVector([0.9067, 0.0933]), prediction=0.0)\n",
      "Row(description='free follow from @itskaisehun go follow !', probability=DenseVector([0.9661, 0.0339]), prediction=0.0)\n",
      "Row(description='give me food...insta ---@JERM_beats', probability=DenseVector([0.9598, 0.0402]), prediction=0.0)\n",
      "Row(description='hi everyone please add me on games console look play online play friends and others gamers players I have PlayStation 3 and PlayStation 4 and 360,wiiUMariomaker', probability=DenseVector([0.9397, 0.0603]), prediction=0.0)\n",
      "Row(description='https://t.co/k5nleOQ50q / #MercerLaw', probability=DenseVector([0.9679, 0.0321]), prediction=0.0)\n",
      "Row(description=\"it turns out there have been a lot of songs written about @thricedotted's catte, haku!!! like who wouldn't write a song about this perfect bb tho :3\", probability=DenseVector([0.9295, 0.0705]), prediction=0.0)\n",
      "Row(description='just trying not to lose my shit', probability=DenseVector([0.9767, 0.0233]), prediction=0.0)\n",
      "Row(description='quer ir no Planeta Terra e í± tem ingressos? o onibus mudou, mas suas chances continuam as mesmas.Siga o novo busí£o: http://t.co/0kD9W9ocdA', probability=DenseVector([0.9989, 0.0011]), prediction=0.0)\n",
      "Row(description='senior editor @Racked // writing a book of essays about crafting for @FlatironBooks // @buzzfeed alum // alanna.okun@racked.com', probability=DenseVector([0.9896, 0.0104]), prediction=0.0)\n",
      "Row(description=' California\"\"\"', probability=DenseVector([0.9609, 0.0391]), prediction=0.0)\n",
      "Row(description='\"\"\"\"', probability=DenseVector([0.8839, 0.1161]), prediction=0.0)\n",
      "Row(description='\"\"\"Ai__\"\"\"', probability=DenseVector([0.9452, 0.0548]), prediction=0.0)\n",
      "Row(description='\"\"\"AlolaFen\"\"\"', probability=DenseVector([0.9186, 0.0814]), prediction=0.0)\n",
      "Row(description=\"#OAKLANDFIGHTCLUB IIIXX OPUS #LetterFromYourBrother #DontGo #SayItIsntSo #StillWater #LoveIsLove #DubNation #RaiderNation #A's #StreetsIsReady #Kurious #DaPlug\", probability=DenseVector([0.8976, 0.1024]), prediction=0.0)\n",
      "Row(description='#RNomics, #RNA biology, RNA #bioinformatics, #RNA_World & #evolution, technologies & resources, daily papers: https://t.co/UaH05PfPIt & https://t.co/cuczvAA7dr', probability=DenseVector([0.9845, 0.0155]), prediction=0.0)\n",
      "Row(description=\"''The 'Hello World' of jokey, generative Twitter bots.'' - @joshmillard Creates bad ideas for startups. Made by @NoraReed with help from just_post.\", probability=DenseVector([0.9902, 0.0098]), prediction=0.0)\n",
      "Row(description='1 Bristolia.', probability=DenseVector([0.9652, 0.0348]), prediction=0.0)\n",
      "Row(description='23. Jays, trays, and fadeaways. T-Wolves and Packers.', probability=DenseVector([0.7276, 0.2724]), prediction=0.0)\n",
      "Row(description='@gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte @gyuterte', probability=DenseVector([0.9972, 0.0028]), prediction=0.0)\n",
      "Row(description='@realajavolkman, @danielepand, @richk', probability=DenseVector([0.9619, 0.0381]), prediction=0.0)\n",
      "Row(description='A SO‰Ð_URCE FOR GOO‹ÎÇD ADVICE AND NOT A B‰ÐÓOT OR DEM‹Ä\\x9dON', probability=DenseVector([0.8125, 0.1875]), prediction=0.0)\n",
      "Row(description='A bot that generates rules for impossible card games. By @atduskgreg.', probability=DenseVector([0.9743, 0.0257]), prediction=0.0)\n",
      "Row(description='A compendium of newly discovered species of clitoris // by @startuple #botALLY', probability=DenseVector([0.7863, 0.2137]), prediction=0.0)\n",
      "Row(description='Art Automata [bot]. See url below for how to help to keep me running.', probability=DenseVector([0.9067, 0.0933]), prediction=0.0)\n",
      "Row(description='Author, Speaker & Force for Good ‰Ñ\\x8f Book One: Beyond #ADHD ‰Ñ\\x8f From Tragedy To Triumph! ‰Ñ\\x8f Agent: @DanaNewman', probability=DenseVector([0.9755, 0.0245]), prediction=0.0)\n",
      "Row(description='AutoMate is a Horizon 2020 EU funded project focused on novel driver-automation cooperation concepts.', probability=DenseVector([0.9385, 0.0615]), prediction=0.0)\n",
      "Row(description='Best Strategy Guides for PÌ«neis Brilhantes series', probability=DenseVector([0.9703, 0.0297]), prediction=0.0)\n",
      "Row(description=\"Born & bred in Singapore, currently residing in Taiwan. We are all placed on earth to leave imprints on each others' lives.\", probability=DenseVector([0.9821, 0.0179]), prediction=0.0)\n",
      "Row(description='Cells move about, have brief encounters, spawn more cells & die. A new life story every 8 hours. Lab technician: @zoot_allures', probability=DenseVector([0.9464, 0.0536]), prediction=0.0)\n",
      "Row(description='Everything about chromatin, enhancers and genome architecture. Manually picked by @IvKrivega', probability=DenseVector([0.958, 0.042]), prediction=0.0)\n",
      "Row(description=\"Excerpts from Shakespeare's works randomly selected, then sprinkled with fucks. Longer excerpts here: http://t.co/CNwtEVVDfs A bot by @deathmtn.\", probability=DenseVector([0.8987, 0.1013]), prediction=0.0)\n",
      "Row(description=\"Exploring Hubble's largest photo (69536x22230px), a little bit at a time. A bot by @joemfox. More info: http://t.co/auTvn3Cjl9\", probability=DenseVector([0.9955, 0.0045]), prediction=0.0)\n",
      "Row(description=\"Faith is taking the first step even when you don't see the whole staircase.\", probability=DenseVector([0.983, 0.017]), prediction=0.0)\n",
      "Row(description='Finance Minister, Minister of Corporate Affairs and Minister of Information and Broadcasting, Government of India', probability=DenseVector([0.7729, 0.2271]), prediction=0.0)\n",
      "Row(description=\"Follow us to know when it's time for a drink. @bugloaf made me.\", probability=DenseVector([0.8682, 0.1318]), prediction=0.0)\n",
      "Row(description='Former Governor of Alaska and GOP Vice Presidential Nominee. Tweets by Sarah Palin signed - SP', probability=DenseVector([0.9857, 0.0143]), prediction=0.0)\n",
      "Row(description='Founder and Chairman of Rasmussen Global', probability=DenseVector([0.956, 0.044]), prediction=0.0)\n",
      "Row(description=\"Free Follow for @jalfiebutler ... follow back please or I'll unfollow _Ùªâ\", probability=DenseVector([0.9488, 0.0512]), prediction=0.0)\n",
      "Row(description='Get thousands followers with this website, fast, cheap and easy. at https://t.co/5IUBOuvsyT', probability=DenseVector([0.9616, 0.0384]), prediction=0.0)\n",
      "Row(description='Graduate student at NYU Tandon School of Engineering. Fan-fic reader and engineer by day soccer defender at night. Manchester United FC is life.', probability=DenseVector([0.9842, 0.0158]), prediction=0.0)\n",
      "Row(description='Hey imToni and im acertified Zumba Intructor.', probability=DenseVector([0.9624, 0.0376]), prediction=0.0)\n",
      "Row(description='I do not bring forgiveness with me; nor forgetfulness. The only ones who can forgive are dead; the living have no right to forget.', probability=DenseVector([0.4153, 0.5847]), prediction=1.0)\n",
      "Row(description='I rehabilitate dogs. I train people. I hope that I can be an inspiration to everyone out there who is trying to live their dream.', probability=DenseVector([0.9863, 0.0137]), prediction=0.0)\n",
      "Row(description=\"I'm an urban dweller who has the beach at heart. When I'm not running promotions or events, you can catch me teaching, at concerts, or, out in the sun.\", probability=DenseVector([0.9396, 0.0604]), prediction=0.0)\n",
      "Row(description=\"I'm that actor in some of the movies you liked and some you didn't. Sometimes I'm in pretty good shape, other times I'm not. Hey, you gotta live, you know?\", probability=DenseVector([0.9855, 0.0145]), prediction=0.0)\n",
      "Row(description='Instruments of mass construction. Made by @sculpin with Cheap Bots Done Quick. Updates twice a day. Occasionally brought to life as @Anomalophones.', probability=DenseVector([0.9877, 0.0123]), prediction=0.0)\n",
      "Row(description='Investigative reporter, Washington Post', probability=DenseVector([0.9607, 0.0393]), prediction=0.0)\n",
      "Row(description='Jenny lives, works, and writes in Brooklyn with her partner, twins, and pit bull.', probability=DenseVector([0.9542, 0.0458]), prediction=0.0)\n",
      "Row(description='MD @SprintPirates, former Head of Acceleration @Sbootcamp,co-founder and former CEO @Seed_Engine, co-founder @seed_academySA #amsterdam #damjuice #startup', probability=DenseVector([0.9786, 0.0214]), prediction=0.0)\n",
      "Row(description='Minister of External affairs', probability=DenseVector([0.9615, 0.0385]), prediction=0.0)\n",
      "Row(description='Mom of four amazing kids, professional speaker and decision strategist. World Series of Poker bracelet winner and author of four books on poker.', probability=DenseVector([0.9866, 0.0134]), prediction=0.0)\n",
      "Row(description=\"More than 75% of Bletchley Park's code-cracking veterans are women. Full list: http://t.co/2tNLDxBxyk. Bot by @marythought.\", probability=DenseVector([0.9855, 0.0145]), prediction=0.0)\n",
      "Row(description='Music & meltdowns', probability=DenseVector([0.8569, 0.1431]), prediction=0.0)\n",
      "Row(description='NHL player with St Louis Blues. GenEthix partner.', probability=DenseVector([0.986, 0.014]), prediction=0.0)\n",
      "Row(description='New Publications in Population Landscape and Ecological Genomics from #arXiv, #bioRxiv and #Pubmed. Curated by Vikram Chhatre (@popgenomics)', probability=DenseVector([0.1594, 0.8406]), prediction=1.0)\n",
      "Row(description='News stories that matter.', probability=DenseVector([0.9483, 0.0517]), prediction=0.0)\n",
      "Row(description='No child should grow up behind prison walls.', probability=DenseVector([0.9694, 0.0306]), prediction=0.0)\n",
      "Row(description='Not part of a famous Canadian comedy troupe. Myers/Briggs: DGAF.', probability=DenseVector([0.9379, 0.0621]), prediction=0.0)\n",
      "Row(description='OFFICIAL account of PoonamPandey. Model & Actress from Mumbai, Instagram : ipoonampandey  Puuhrulz@gmail.com  Snapchat: ipoonampandey', probability=DenseVector([0.7354, 0.2646]), prediction=0.0)\n",
      "Row(description='OT4 and Zayn__', probability=DenseVector([0.9652, 0.0348]), prediction=0.0)\n",
      "Row(description='Official Twitter Site for Actor Gil Birmingham.', probability=DenseVector([0.8997, 0.1003]), prediction=0.0)\n",
      "Row(description='Official account of Governor Charlie Baker of Massachusetts.', probability=DenseVector([0.9409, 0.0591]), prediction=0.0)\n",
      "Row(description='Old age has deformities enough of its own. It should never add to them the deformity of vice.', probability=DenseVector([0.9108, 0.0892]), prediction=0.0)\n",
      "Row(description='Old tweets are kind of weird. This bot retweets one of the first 7500 tweets (first 90 days of Twitter) four times a day. // by @tinysubversions', probability=DenseVector([0.9945, 0.0055]), prediction=0.0)\n",
      "Row(description='Owner Of GLAM Beverly Hills,Model, Actress, Business Woman, Playmate, Reality Star, Brand, CEO, #Xtina Instagram @KristinaShannon1 SnapChat glamxtina', probability=DenseVector([0.9107, 0.0893]), prediction=0.0)\n",
      "Row(description='Pastor of Empowerment Temple in Baltimore, MD', probability=DenseVector([0.8887, 0.1113]), prediction=0.0)\n",
      "Row(description='Pastor, IBABI, Igreja Batista Bí_blica, Jacareí\\x8d, SP', probability=DenseVector([0.5638, 0.4362]), prediction=0.0)\n",
      "Row(description=\"Pictures taken by @NOAA buoys in the middle of the ocean. I'm a bot by @fitnr\", probability=DenseVector([0.9004, 0.0996]), prediction=0.0)\n",
      "Row(description='Pretty girl from Denmark. Want to meet somebody for virt. Find me here https://t.co/NDxXt2gbnZ. My nick Musi', probability=DenseVector([0.9828, 0.0172]), prediction=0.0)\n",
      "Row(description='Purveyor of custom scientific eponyms since 2014. Eponyms coined for random followers every few hours. Bot by @arbesman.', probability=DenseVector([0.9722, 0.0278]), prediction=0.0)\n",
      "Row(description=\"Queen's NRI Hospital, a 380 bed multi-specialty acute-cum-critical care referral hospital, is one of the most well-equipped and premier hospitals in Vizag.\", probability=DenseVector([0.9918, 0.0082]), prediction=0.0)\n",
      "Row(description='Quoting those too often overlooked. Tweet a hashtag @the_underquoted to see if any quotes match that word. Tweets one unsolicited quote a day.', probability=DenseVector([0.9837, 0.0163]), prediction=0.0)\n",
      "Row(description='Reminders to take your medications from a robot that swallowed a thesaurus. By @NoraReed.', probability=DenseVector([0.9349, 0.0651]), prediction=0.0)\n",
      "Row(description='Replacement for @FalseFlagBot R.I.P. #nWo #illuminati #falseflag', probability=DenseVector([0.8846, 0.1154]), prediction=0.0)\n",
      "Row(description='Retweet bot for my #indiedev #gameDev bros and gals! Follow for increased retweet chance! Also follow my main account @quantomworks ! Happy coding :)', probability=DenseVector([0.9494, 0.0506]), prediction=0.0)\n",
      "Row(description='Revelation can be more perilous than Revolution - Nabokov. That, and #FinTech #FemTech. Lots of both, actually.', probability=DenseVector([0.9786, 0.0214]), prediction=0.0)\n",
      "Row(description='SOCIAL ON GLOSSATORY: the branch of the considered addered poker by looses - a bot by @bombinans', probability=DenseVector([0.9907, 0.0093]), prediction=0.0)\n",
      "Row(description='THIS IS RAMBO', probability=DenseVector([0.8776, 0.1224]), prediction=0.0)\n",
      "Row(description='Taylor Gang', probability=DenseVector([0.9367, 0.0633]), prediction=0.0)\n",
      "Row(description='The White Album Deluxe Edition out now - download on iTunes https://t.co/wBYl3ZbxJ2 listen on Spotify https://t.co/TfENgKaTfm Tour dates https://t.co/GDUMuOiLaf', probability=DenseVector([0.9023, 0.0977]), prediction=0.0)\n",
      "Row(description='The beast howls in my veins', probability=DenseVector([0.9348, 0.0652]), prediction=0.0)\n",
      "Row(description=\"Train - Fight - Win! I'm 57-0 kickboxer and 5 time world champion working hard every day to become an elite MMA champion. Currently 8-1-1 in the UFC\", probability=DenseVector([0.9902, 0.0098]), prediction=0.0)\n",
      "Row(description='Tweets BuzzFeed titles in Hulk-talk / Not affiliated with BuzzFeed / Bot by @undoingsarah', probability=DenseVector([0.9575, 0.0425]), prediction=0.0)\n",
      "Row(description='Twitter CMO. Favorite title: Mama. Never, ever a dull moment. #WWED', probability=DenseVector([0.9491, 0.0509]), prediction=0.0)\n",
      "Row(description='Updated Daily for tips to lose weight from me and from others.', probability=DenseVector([0.8134, 0.1866]), prediction=0.0)\n",
      "Row(description='Visual storyteller | Photographer based in Italy.', probability=DenseVector([0.9614, 0.0386]), prediction=0.0)\n",
      "Row(description='We added you on Myspace. Our new album SOME THINGS NEVER LEAVE YOU available now. @natehenrysays @dankoch', probability=DenseVector([0.9459, 0.0541]), prediction=0.0)\n",
      "Row(description='We are the music makers, and we are the dreamers of dreams...', probability=DenseVector([0.9268, 0.0732]), prediction=0.0)\n",
      "Row(description='We feed 1.4M kids in India daily; promoting education and eradicating hunger. Visit us at http://t.co/KeAZERhd0J', probability=DenseVector([0.6874, 0.3126]), prediction=0.0)\n",
      "Row(description='Wife åá Mother åá Decorator åá Cook åá PartyThrower åá Singer åá Producer åá Writer åá Musician åá Whew!', probability=DenseVector([0.8885, 0.1115]), prediction=0.0)\n",
      "Row(description='With algorithms subtle and discrete / I seek iambic writings to retweet.', probability=DenseVector([0.9826, 0.0174]), prediction=0.0)\n",
      "Row(description=\"You were looking for a bot, and then you found a bot. I'm Miserable Now, by @mambocab. ~5 tweets/day. Code/acknowledgments on GitHub.\", probability=DenseVector([0.9946, 0.0054]), prediction=0.0)\n",
      "Row(description='[‰ª»]', probability=DenseVector([0.902, 0.098]), prediction=0.0)\n",
      "Row(description='bot by @ckolderup ‰Û¢ #botALLY', probability=DenseVector([0.9753, 0.0247]), prediction=0.0)\n",
      "Row(description='bot by @ckolderup ‰Û¢ #botALLY', probability=DenseVector([0.9753, 0.0247]), prediction=0.0)\n",
      "Row(description=\"butts. butt botts. butt things. https://t.co/9K7GC6ImGN #rumpology - @speckninja (bot favs tweets containing 'butt')\", probability=DenseVector([0.8883, 0.1117]), prediction=0.0)\n",
      "Row(description=\"colors.  all of 'em. | developed by @vogon; feel free to send him feedback/feature requests\", probability=DenseVector([0.731, 0.269]), prediction=0.0)\n",
      "Row(description='follow @drakeftagb', probability=DenseVector([0.9475, 0.0525]), prediction=0.0)\n",
      "Row(description='go subscribe to my channel http://t.co/tMLNHqUGp9', probability=DenseVector([0.9435, 0.0565]), prediction=0.0)\n",
      "Row(description=\"how i'd wish that were so.\", probability=DenseVector([0.9643, 0.0357]), prediction=0.0)\n",
      "Row(description='http://t.co/YfHoThSDVQ...', probability=DenseVector([0.9387, 0.0613]), prediction=0.0)\n",
      "Row(description='portmanteaus, portmanteaus everywhere // by @thricedotted', probability=DenseVector([0.9273, 0.0727]), prediction=0.0)\n",
      "Row(description='starting leade.rs', probability=DenseVector([0.9218, 0.0782]), prediction=0.0)\n",
      "Row(description='weeee willll weee willll rock you!', probability=DenseVector([0.9402, 0.0598]), prediction=0.0)\n",
      "Row(description=\"you're here with me now\", probability=DenseVector([0.9617, 0.0383]), prediction=0.0)\n",
      "Row(description='\\x8dµµÜ‰Í_\\x8f\\x8fÜ\\x81\\x8dÜ\\x81_Ü\\x81»', probability=DenseVector([0.9277, 0.0723]), prediction=0.0)\n",
      "Row(description=' FL\"\"\"', probability=DenseVector([0.889, 0.111]), prediction=0.0)\n",
      "Row(description=' South Yorkshire', probability=DenseVector([0.9636, 0.0364]), prediction=0.0)\n",
      "Row(description='\"\"\"\"', probability=DenseVector([0.8839, 0.1161]), prediction=0.0)\n",
      "Row(description='\"\"\"Bulu Bulu Kehidupan\"\"\"', probability=DenseVector([0.9366, 0.0634]), prediction=0.0)\n",
      "Row(description='\"\"\"Saint Seiya 4Ever\"\"\"', probability=DenseVector([0.9561, 0.0439]), prediction=0.0)\n",
      "Row(description='\"\"\"The official Manchester City Twitter account | Supporter Services __ @ManCityHelp | Snapchat __ mancityofficial\"\"\"', probability=DenseVector([0.8455, 0.1545]), prediction=0.0)\n",
      "Row(description='#VampireLife bookings for #JimJones bookjimjones@gmail.com  info@nextofkinent.com', probability=DenseVector([0.9668, 0.0332]), prediction=0.0)\n",
      "Row(description=\"'Wow' Out Now - https://t.co/D8mflkQEe0\", probability=DenseVector([0.9683, 0.0317]), prediction=0.0)\n",
      "Row(description='*IN BETA* Low-res, slightly bizarre Open Access images from the Met (via @MuseumBot) crossed with palettes from @colourlovers. Powered by @uncontext. By @_ARP.', probability=DenseVector([0.9669, 0.0331]), prediction=0.0)\n",
      "Row(description='1', probability=DenseVector([0.9528, 0.0472]), prediction=0.0)\n",
      "Row(description='@styletiana is hot.', probability=DenseVector([0.8715, 0.1285]), prediction=0.0)\n",
      "Row(description='A bot by @NoraReed Patreon: https://t.co/f7OKH9MO9D Tip Jar: https://t.co/KOMoL6IrsM‰Û_ FAQ: https://t.co/Z49vqlFP4x', probability=DenseVector([0.9632, 0.0368]), prediction=0.0)\n",
      "Row(description=\"A bot that creates hilarious joax via Google's autocomplete. By @deathmtn.\", probability=DenseVector([0.9352, 0.0648]), prediction=0.0)\n",
      "Row(description='A bot that generates random malfunctioning equipment, created by @notinventedhere using http://t.co/XpDujaprri', probability=DenseVector([0.9782, 0.0218]), prediction=0.0)\n",
      "Row(description='A bot tweeting links to new archaeological journal articles. Limited to those journals that provide RSS!', probability=DenseVector([0.9875, 0.0125]), prediction=0.0)\n",
      "Row(description='Activist. Actress. Artist. Instagram: @lindsaylohan https://t.co/FjAZzhuK6y Management: scott@honestmg.com', probability=DenseVector([0.8732, 0.1268]), prediction=0.0)\n",
      "Row(description='Anchor of Erin Burnett OutFront.', probability=DenseVector([0.9082, 0.0918]), prediction=0.0)\n",
      "Row(description='Anime, Game, Programming, Tech, and other nonsense äóñ in Thai, English', probability=DenseVector([0.9066, 0.0934]), prediction=0.0)\n",
      "Row(description='Boutique Bollywood Actor', probability=DenseVector([0.8907, 0.1093]), prediction=0.0)\n",
      "Row(description='Carbon-based multicellular lifeform.', probability=DenseVector([0.9583, 0.0417]), prediction=0.0)\n",
      "Row(description='Cat lady, singer, actor, love improv & living in Tokyo', probability=DenseVector([0.9735, 0.0265]), prediction=0.0)\n",
      "Row(description='Creating a new blend of #classical, #jazz, #rock, #pop and #worldmusic using #cello as a common denominator.  Striving to make #globalimpact through #music.', probability=DenseVector([0.9931, 0.0069]), prediction=0.0)\n",
      "Row(description='Dashboard Confessional Tix available NOW for our up close and personal tour in Jan and Feb of 2017: https://t.co/Bj0G7NIhy1', probability=DenseVector([0.9888, 0.0112]), prediction=0.0)\n",
      "Row(description='Department of History, College Students', probability=DenseVector([0.9442, 0.0558]), prediction=0.0)\n",
      "Row(description='Design Thinker, Dev Ops Practitioner, Lean Coach.', probability=DenseVector([0.9459, 0.0541]), prediction=0.0)\n",
      "Row(description=\"Established in 1995, NYU's Remarque Institute supports the multi-disciplinary and comparative study of Europe and its near neighbors.\", probability=DenseVector([0.9867, 0.0133]), prediction=0.0)\n",
      "Row(description=\"Every combination of letters that is not an English word, including some common slang and jargon. Task will complete long after we're dead. An @_ARP bot.\", probability=DenseVector([0.9748, 0.0252]), prediction=0.0)\n",
      "Row(description='Extremely powerful being, do not insult me. THIS IS A COMEDY ACCOUNT FOR COMEDY', probability=DenseVector([0.6202, 0.3798]), prediction=0.0)\n",
      "Row(description='FITNESS', probability=DenseVector([0.8939, 0.1061]), prediction=0.0)\n",
      "Row(description='Fake James Joyce novel titles. A bot by @sillygwailo. #botALLY', probability=DenseVector([0.9845, 0.0155]), prediction=0.0)\n",
      "Row(description='Family over everything', probability=DenseVector([0.9189, 0.0811]), prediction=0.0)\n",
      "Row(description='Fast and steady wins the race.', probability=DenseVector([0.9628, 0.0372]), prediction=0.0)\n",
      "Row(description='Film buff,Actor, Director, Dancer, Writer, Producer', probability=DenseVector([0.904, 0.096]), prediction=0.0)\n",
      "Row(description='Friend of the program.', probability=DenseVector([0.9108, 0.0892]), prediction=0.0)\n",
      "Row(description='From Russia, live in Amsterdam. QA engineer, test automation.', probability=DenseVector([0.8798, 0.1202]), prediction=0.0)\n",
      "Row(description='Generating äóìself-portraitsäó\\x9d once a day äó¢ A bot by @ashur äó¢ #botALLY', probability=DenseVector([0.9818, 0.0182]), prediction=0.0)\n",
      "Row(description=\"Give me a museum and I'll fill it.\", probability=DenseVector([0.9709, 0.0291]), prediction=0.0)\n",
      "Row(description=\"Host of The Roe Conn Show afternoons on Chicago's WGN Radio and contributor to ABC7's Windy City Live.\", probability=DenseVector([0.9914, 0.0086]), prediction=0.0)\n",
      "Row(description='I retweet questions followed by answers. Brought to you by @rfreebern.', probability=DenseVector([0.9804, 0.0196]), prediction=0.0)\n",
      "Row(description='I tweet a new horizon view every six hours.  Created by @acgodliman using cheapbotsdonequick. WIP', probability=DenseVector([0.9791, 0.0209]), prediction=0.0)\n",
      "Row(description=\"I'm just your average procedural avatar generating twitter bot. @bzgeb is my creator\", probability=DenseVector([0.9887, 0.0113]), prediction=0.0)\n",
      "Row(description='Just some space stories. A http://t.co/8dBPX7FlIa bot (with occasional analogue stories) by @notinventedhere and @thos_thom.', probability=DenseVector([0.9979, 0.0021]), prediction=0.0)\n",
      "Row(description='Late adopter.', probability=DenseVector([0.8731, 0.1269]), prediction=0.0)\n",
      "Row(description='Legitimate reviews from 100% people, every two minutes.', probability=DenseVector([0.9803, 0.0197]), prediction=0.0)\n",
      "Row(description=\"Let's keep this thing going, gang! #AddaWordRuinaMovie\", probability=DenseVector([0.9462, 0.0538]), prediction=0.0)\n",
      "Row(description='Looking to stick it to the man yeah I hate the man', probability=DenseVector([0.9683, 0.0317]), prediction=0.0)\n",
      "Row(description='Magic cards generated by a Recurrent Neural Network, posted once a day. Not Mark Rosewater.', probability=DenseVector([0.8793, 0.1207]), prediction=0.0)\n",
      "Row(description='Marketing guy, social gadfly, and general man about town', probability=DenseVector([0.8055, 0.1945]), prediction=0.0)\n",
      "Row(description='On my standup comedy tour now! Details at https://t.co/2zXkcRPGgX', probability=DenseVector([0.9136, 0.0864]), prediction=0.0)\n",
      "Row(description='Pre-order The Blood Album on iTunes. https://t.co/pukqh1O7id', probability=DenseVector([0.9536, 0.0464]), prediction=0.0)\n",
      "Row(description='Principal Engineer at @voxmediainc / @voxproduct. Tweets my own. Jokes shamelessly ripped from Reddit. Prev: @disqus, @threespot. ä\\x9d_ StarCraft', probability=DenseVector([0.5762, 0.4238]), prediction=0.0)\n",
      "Row(description='Producer/Songwriter/Lead Singer of Sixx:A.M.', probability=DenseVector([0.9614, 0.0386]), prediction=0.0)\n",
      "Row(description='Secretly triggered subtweetbombing encouragement bot inspired by https://t.co/EMTnCTpOxx', probability=DenseVector([0.9715, 0.0285]), prediction=0.0)\n",
      "Row(description=\"Send a direct message mentioning people you really like :)                  (I'm a bot, and I do only use the @ of who you mention) (I'm a bit busy, be patient)\", probability=DenseVector([0.9972, 0.0028]), prediction=0.0)\n",
      "Row(description='Serbia is a beautiful European country, with rich history, culture, welcoming and loving people and great night life and strong art and cafe culture.', probability=DenseVector([0.9362, 0.0638]), prediction=0.0)\n",
      "Row(description='Snap: @maalenacarvalho', probability=DenseVector([0.9528, 0.0472]), prediction=0.0)\n",
      "Row(description='Social Activist | Nationalist | Swayamsevak | BJP Delhi | Namo Fan | Followed By the Honourable  PM @narendramodi ji.', probability=DenseVector([0.9951, 0.0049]), prediction=0.0)\n",
      "Row(description='Stage Manager, Writer, Leader...and more.', probability=DenseVector([0.9464, 0.0536]), prediction=0.0)\n",
      "Row(description='Sup', probability=DenseVector([0.9539, 0.0461]), prediction=0.0)\n",
      "Row(description='Television has brought back murder into the home - where it belongs.', probability=DenseVector([0.9717, 0.0283]), prediction=0.0)\n",
      "Row(description='Tennis player.', probability=DenseVector([0.935, 0.065]), prediction=0.0)\n",
      "Row(description='Topics, news and more about nature.', probability=DenseVector([0.9136, 0.0864]), prediction=0.0)\n",
      "Row(description='Tweeting all the languages. All of them. Process should finish sometime in October 2015. Created by @OnnaAdele.', probability=DenseVector([0.9304, 0.0696]), prediction=0.0)\n",
      "Row(description='Tweeting every letter in the english language.', probability=DenseVector([0.9221, 0.0779]), prediction=0.0)\n",
      "Row(description=\"Tweets from the Mayor of St. Louis' personal website. The Mayor's own tweets are signed #fgs, his initials.\", probability=DenseVector([0.9482, 0.0518]), prediction=0.0)\n",
      "Row(description='Tweets ~10 times a day between 8am-10pm PST. Will probably get more vaporwave-y as time goes by. Complaints: @beaugunderson', probability=DenseVector([0.8911, 0.1089]), prediction=0.0)\n",
      "Row(description='Twitterbot of cichlid PubMed papers (inspired by @fly_papers). Image Astatotilapia calliptera, K. Woodhouse. Curated by @domino_joyce.', probability=DenseVector([0.3268, 0.6732]), prediction=1.0)\n",
      "Row(description='Under Construction', probability=DenseVector([0.8893, 0.1107]), prediction=0.0)\n",
      "Row(description='Violet 100 event link: https://t.co/hf0W3M7i2S', probability=DenseVector([0.963, 0.037]), prediction=0.0)\n",
      "Row(description='Welcome to http://t.co/OgGcZs9E0w. I hope to immerse you into a world all about  Oil Painting. It can become a serious passion. I Love painting!', probability=DenseVector([0.9804, 0.0196]), prediction=0.0)\n",
      "Row(description='Well-fed artist.', probability=DenseVector([0.9211, 0.0789]), prediction=0.0)\n",
      "Row(description='What will John Oliver DESTROY next? A @ThisIsFusion bot. http://t.co/TITeSH2I5J', probability=DenseVector([0.9482, 0.0518]), prediction=0.0)\n",
      "Row(description='You dont have to follow this account, Just follow this one @LethargicJOE to get your free follow ;) Thanks!', probability=DenseVector([0.9766, 0.0234]), prediction=0.0)\n",
      "Row(description='director.', probability=DenseVector([0.9023, 0.0977]), prediction=0.0)\n",
      "Row(description='free follow from @octloveslukey, go follow her for more', probability=DenseVector([0.9028, 0.0972]), prediction=0.0)\n",
      "Row(description='fuck it, put a chip in it. say hello: internetofshit@gmail.com', probability=DenseVector([0.901, 0.099]), prediction=0.0)\n",
      "Row(description='snail half dedicated to @inky // complaints to @beaugunderson', probability=DenseVector([0.9845, 0.0155]), prediction=0.0)\n",
      "Row(description='this is the only official ashlee simpson ross twitter. click your heels three times and think of me...chick-a-boom', probability=DenseVector([0.9825, 0.0175]), prediction=0.0)\n",
      "Row(description='\"\"\"\"', probability=DenseVector([0.8839, 0.1161]), prediction=0.0)\n",
      "Row(description='@B_Real | @OGSenDog | @ericbobo | @DJ_Muggs | @juliog1580kday', probability=DenseVector([0.9502, 0.0498]), prediction=0.0)\n",
      "Row(description=\"Advice is what we ask for when we already know the answer but wish we didn't.\", probability=DenseVector([0.9249, 0.0751]), prediction=0.0)\n",
      "Row(description='Agricultural Engineer, likes to joke and trying to live a certain balance between his laptop at the office and his shovel in the field.', probability=DenseVector([0.7822, 0.2178]), prediction=0.0)\n",
      "Row(description='BEEP BOOP WHITE PEOPLE', probability=DenseVector([0.9581, 0.0419]), prediction=0.0)\n",
      "Row(description=\"CNN's host of @ReliableSources and senior media correspondent. Formerly @nytimes, @tvnewser and Top of the Morning. Email: bstelter@gmail.com\", probability=DenseVector([0.8778, 0.1222]), prediction=0.0)\n",
      "Row(description='Daily RSS Feed for Protein Hot Spot Prediction papers. Maintained by @selinkaragulle', probability=DenseVector([0.6073, 0.3927]), prediction=0.0)\n",
      "Row(description=\"Every word in the English language, in Comic Sans MS. My friends think I'm fun! By @avestal.\", probability=DenseVector([0.9859, 0.0141]), prediction=0.0)\n",
      "Row(description='Get the latest BLONDIE news at http://t.co/LIHTvKT3h7!', probability=DenseVector([0.9389, 0.0611]), prediction=0.0)\n",
      "Row(description=\"I DONT NEE A FUCKIN SLOGGIN FUC A TEAM I JUST FOLLOW ACK UNFOLLOW ME AND I'LL KICK YOUR ASS\", probability=DenseVector([0.9521, 0.0479]), prediction=0.0)\n",
      "Row(description='I tweet pentatonic ditties.', probability=DenseVector([0.8812, 0.1188]), prediction=0.0)\n",
      "Row(description=\"I'm a Bot; I randomly retweet a tweet from the public timeline, and... that's just it.\", probability=DenseVector([0.9758, 0.0242]), prediction=0.0)\n",
      "Row(description='This should be the quickest route, but it depends on the traffic', probability=DenseVector([0.9438, 0.0562]), prediction=0.0)\n",
      "Row(description='UXer', probability=DenseVector([0.9503, 0.0497]), prediction=0.0)\n",
      "Row(description='another one bites the dust || dancer', probability=DenseVector([0.9457, 0.0543]), prediction=0.0)\n"
     ]
    }
   ],
   "source": [
    "from pyspark.ml import Pipeline\n",
    "from pyspark.ml.classification import LogisticRegression\n",
    "from pyspark.ml.evaluation import BinaryClassificationEvaluator\n",
    "from pyspark.ml.feature import HashingTF, Tokenizer\n",
    "from pyspark.ml.tuning import CrossValidator, ParamGridBuilder\n",
    "\n",
    "\n",
    "# We now treat the Pipeline as an Estimator, wrapping it in a CrossValidator instance.\n",
    "# This will allow us to jointly choose parameters for all Pipeline stages.\n",
    "# A CrossValidator requires an Estimator, a set of Estimator ParamMaps, and an Evaluator.\n",
    "# We use a ParamGridBuilder to construct a grid of parameters to search over.\n",
    "# With 3 values for hashingTF.numFeatures and 2 values for lr.regParam,\n",
    "# this grid will have 3 x 2 = 6 parameter settings for CrossValidator to choose from.\n",
    "paramGrid = ParamGridBuilder() \\\n",
    "    .addGrid(hashingTF.numFeatures, [10, 100, 1000]) \\\n",
    "    .addGrid(lr.regParam, [0.1, 0.01]) \\\n",
    "    .build()\n",
    "\n",
    "\n",
    "crossval = CrossValidator(estimator=pipeline,\n",
    "                          estimatorParamMaps=paramGrid,\n",
    "                          evaluator=BinaryClassificationEvaluator(),\n",
    "                          numFolds=3)  # use 3+ folds in practice\n",
    "\n",
    "\n",
    "# Run cross-validation, and choose the best set of parameters.\n",
    "cvModel = crossval.fit(trainingData)\n",
    "\n",
    "prediction = cvModel.transform(testData)\n",
    "selected = prediction.select(\"description\", \"probability\", \"prediction\")\n",
    "for row in selected.collect():\n",
    "    print(row)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the text output search for\n",
    "`prediction=1`\n",
    "\n",
    "Write in the chat which `description` got classified as a bot!\n",
    "\n",
    "Notice that in some of the `description` exists the word - `bot`.\n",
    "\n",
    "Meaning your algorithm found it without being told directly to search for the word bot 🤓"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the last task, you used `BinaryClassificationEvaluator` since it is more accurate to our needs. It works with Binary data - bot or human.\n",
    "`ParamGridBuilder` is a utility that helps us construct a parameter grid for our algorithm. It helps us test out various models built with various params. \n",
    "\n",
    "`ParamGridBuilder` is part of `pyspark.ml.tuning` lib. \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Well Done! 👏👏👏\n",
    "## You just finished chapter 4: Spark ML - Evaluating models and intro to Pipelines\n",
    "## This was the last chapter for **Apache Spark ML First Steps**\n",
    "\n",
    "## I hope you enjoyed it!\n",
    "\n",
    "\n",
    "[@adipolak](https://twitter.com/AdiPolak)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}
